-- Logs begin at Fri 2022-05-27 07:49:41 UTC, end at Fri 2022-05-27 08:53:30 UTC. -- May 27 08:25:33.185602 dv-osbrick-762776-7-ceph systemd[1]: Starting Devstack devstack@keystone.service... May 27 08:25:33.194393 dv-osbrick-762776-7-ceph devstack@keystone.service[87162]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 27 08:25:33.196889 dv-osbrick-762776-7-ceph devstack@keystone.service[87162]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri May 27 08:25:33 2022] *** May 27 08:25:33.196889 dv-osbrick-762776-7-ceph devstack@keystone.service[87162]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 27 08:25:33.196889 dv-osbrick-762776-7-ceph devstack@keystone.service[87162]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 27 08:25:33.196889 dv-osbrick-762776-7-ceph devstack@keystone.service[87162]: nodename: dv-osbrick-762776-7-ceph May 27 08:25:33.196889 dv-osbrick-762776-7-ceph devstack@keystone.service[87162]: machine: x86_64 May 27 08:25:33.196889 dv-osbrick-762776-7-ceph devstack@keystone.service[87162]: clock source: unix May 27 08:25:33.196889 dv-osbrick-762776-7-ceph devstack@keystone.service[87162]: pcre jit disabled May 27 08:25:33.196889 dv-osbrick-762776-7-ceph devstack@keystone.service[87162]: detected number of CPU cores: 4 May 27 08:25:33.196889 dv-osbrick-762776-7-ceph devstack@keystone.service[87162]: current working directory: / May 27 08:25:33.196889 dv-osbrick-762776-7-ceph devstack@keystone.service[87162]: detected binary path: /usr/bin/uwsgi-core May 27 08:25:33.197436 dv-osbrick-762776-7-ceph devstack@keystone.service[87162]: your processes number limit is 47680 May 27 08:25:33.197436 dv-osbrick-762776-7-ceph devstack@keystone.service[87162]: your memory page size is 4096 bytes May 27 08:25:33.197436 dv-osbrick-762776-7-ceph devstack@keystone.service[87162]: detected max file descriptor number: 2048 May 27 08:25:33.197436 dv-osbrick-762776-7-ceph devstack@keystone.service[87162]: lock engine: pthread robust mutexes May 27 08:25:33.197436 dv-osbrick-762776-7-ceph devstack@keystone.service[87162]: thunder lock: enabled May 27 08:25:33.197436 dv-osbrick-762776-7-ceph devstack@keystone.service[87162]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 27 08:25:33.197436 dv-osbrick-762776-7-ceph devstack@keystone.service[87162]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 27 08:25:33.253490 dv-osbrick-762776-7-ceph devstack@keystone.service[87162]: Python main interpreter initialized at 0x56204916d9c0 May 27 08:25:33.253490 dv-osbrick-762776-7-ceph devstack@keystone.service[87162]: python threads support enabled May 27 08:25:33.253490 dv-osbrick-762776-7-ceph devstack@keystone.service[87162]: your server socket listen backlog is limited to 100 connections May 27 08:25:33.253490 dv-osbrick-762776-7-ceph devstack@keystone.service[87162]: your mercy for graceful operations on workers is 90 seconds May 27 08:25:33.253880 dv-osbrick-762776-7-ceph devstack@keystone.service[87162]: mapped 403077 bytes (393 KB) for 2 cores May 27 08:25:33.253957 dv-osbrick-762776-7-ceph devstack@keystone.service[87162]: *** Operational MODE: preforking *** May 27 08:25:33.254189 dv-osbrick-762776-7-ceph devstack@keystone.service[87162]: *** uWSGI is running in multiple interpreter mode *** May 27 08:25:33.254189 dv-osbrick-762776-7-ceph devstack@keystone.service[87162]: spawned uWSGI master process (pid: 87162) May 27 08:25:33.254404 dv-osbrick-762776-7-ceph systemd[1]: Started Devstack devstack@keystone.service. May 27 08:25:33.255145 dv-osbrick-762776-7-ceph devstack@keystone.service[87162]: spawned uWSGI worker 1 (pid: 87172, cores: 1) May 27 08:25:33.260626 dv-osbrick-762776-7-ceph devstack@keystone.service[87162]: spawned uWSGI worker 2 (pid: 87173, cores: 1) May 27 08:25:33.260626 dv-osbrick-762776-7-ceph devstack@keystone.service[87162]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 27 08:25:39.207405 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 27 08:25:39.207405 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: from cryptography.utils import int_from_bytes May 27 08:25:39.208227 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 27 08:25:39.208227 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: from cryptography.utils import int_from_bytes May 27 08:25:39.211135 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 27 08:25:39.211135 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: from cryptography.utils import int_from_bytes May 27 08:25:39.211809 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 27 08:25:39.211809 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: from cryptography.utils import int_from_bytes May 27 08:25:39.259617 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 27 08:25:39.259872 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 27 08:25:39.259957 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 27 08:25:39.260044 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 27 08:25:39.260171 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] command line args: [] {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 27 08:25:39.260278 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] command line args: [] {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 27 08:25:39.260351 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 27 08:25:39.260418 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 27 08:25:39.260487 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] ================================================================================ {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 27 08:25:39.260552 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] ================================================================================ {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 27 08:25:39.260696 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] admin_token = **** {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 08:25:39.260770 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] admin_token = **** {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 08:25:39.260913 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] config_dir = [] {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 08:25:39.261002 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] config_dir = [] {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 08:25:39.261061 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 08:25:39.261118 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 08:25:39.261256 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] config_source = [] {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 08:25:39.261341 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] config_source = [] {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 08:25:39.261417 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] debug = True {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 08:25:39.261487 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] debug = True {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 08:25:39.261586 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 08:25:39.261863 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 08:25:39.261954 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 08:25:39.262047 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 08:25:39.262159 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] insecure_debug = False {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 08:25:39.262265 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] insecure_debug = False {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 08:25:39.262345 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 08:25:39.262472 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 08:25:39.262586 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 08:25:39.262720 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 08:25:39.262795 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] list_limit = None {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 08:25:39.262955 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] list_limit = None {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 08:25:39.263036 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] log_config_append = None {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 08:25:39.263126 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 08:25:39.263201 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] log_config_append = None {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 08:25:39.263302 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 08:25:39.263391 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] log_dir = None {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 08:25:39.263468 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] log_file = None {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 08:25:39.263526 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] log_dir = None {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 08:25:39.263644 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] log_file = None {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 08:25:39.263716 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 08:25:39.263900 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 08:25:39.264010 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 08:25:39.264118 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 08:25:39.264218 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 08:25:39.264368 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 08:25:39.264471 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 08:25:39.264579 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 08:25:39.264731 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 08:25:39.264886 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 08:25:39.264973 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 08:25:39.265093 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 08:25:39.265167 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 08:25:39.265272 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 08:25:39.265350 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 08:25:39.265465 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 08:25:39.265585 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 08:25:39.265666 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 08:25:39.265787 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 08:25:39.265909 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 08:25:39.266033 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 08:25:39.266170 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 08:25:39.266260 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 08:25:39.266382 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 08:25:39.266462 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 08:25:39.266598 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 08:25:39.266692 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] notification_format = cadf {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 08:25:39.266906 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 08:25:39.266992 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] notification_format = cadf {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 08:25:39.267228 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 08:25:39.267416 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.62/identity {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 08:25:39.267595 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] publish_errors = False {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 08:25:39.267741 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.62/identity {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 08:25:39.267859 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 08:25:39.267962 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] publish_errors = False {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 08:25:39.268058 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 08:25:39.268151 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 08:25:39.268251 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 08:25:39.268370 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 08:25:39.268472 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 08:25:39.268578 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 08:25:39.268773 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 08:25:39.268876 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 08:25:39.268978 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] standard_threads = False {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 08:25:39.269074 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 08:25:39.269176 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] strict_password_check = False {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 08:25:39.269283 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] standard_threads = False {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 08:25:39.269380 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 08:25:39.269480 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] strict_password_check = False {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 08:25:39.269576 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] use_eventlog = False {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 08:25:39.269681 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] use_journal = False {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 08:25:39.269801 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 08:25:39.269921 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] use_json = False {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 08:25:39.270041 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] use_eventlog = False {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 08:25:39.270156 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] use_stderr = False {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 08:25:39.270270 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] use_journal = False {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 08:25:39.270384 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] use_syslog = False {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 08:25:39.270506 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] use_json = False {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 08:25:39.270621 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] watch_log_file = False {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 08:25:39.270734 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] use_stderr = False {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 08:25:39.270734 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] use_syslog = False {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 08:25:39.270941 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.271061 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] watch_log_file = False {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 08:25:39.271183 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.271298 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.271413 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.271527 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.271640 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.271768 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.271883 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.271997 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.272110 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.272228 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.272342 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.272342 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.272649 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.272797 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.273483 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.273604 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.273724 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.273724 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.273952 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.273952 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.274191 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.274312 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.274431 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.274563 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.274680 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.274799 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.274916 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.274916 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.275128 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.275253 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.275374 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.275488 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.275602 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.275714 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.275832 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.275953 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.276069 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.276182 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.276295 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.276408 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.276521 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.276691 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.276809 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.276929 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.277043 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.277156 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.277274 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.277398 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.277520 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.277520 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.277734 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.277847 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.277960 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.278081 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.278196 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.278314 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.278428 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.278539 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.278651 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.278843 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.278960 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.279073 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.279186 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.279303 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.279417 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.279541 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.279662 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.279777 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.279896 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.280010 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.280131 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.280246 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.280365 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.280479 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.280675 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.280804 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.280929 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.281044 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.281163 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.281276 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.281456 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.281571 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.281693 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.281807 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.281921 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.282034 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.282148 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.282266 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.282387 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.282508 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.282621 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.282734 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.282852 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.282967 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.283094 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.283210 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.283322 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.283440 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.283554 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.283666 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.283787 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.283907 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.284052 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.284176 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.284292 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.284411 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.284534 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.284718 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.284835 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.284948 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.285063 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.285187 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.285312 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.285427 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.285541 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.285655 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.285768 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.285882 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.286005 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.286129 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.286251 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.286381 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.286506 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.286622 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.286742 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.286868 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.286990 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.287159 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.287281 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.287397 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.287397 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.287617 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.287617 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.287848 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.287969 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.288331 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.288468 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.288583 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.288583 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.288832 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.288947 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.289061 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.289174 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.289300 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.289454 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.289611 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.289719 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] cache.enabled = True {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.289842 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.289842 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.290067 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.290190 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.290307 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.290428 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] cache.enabled = True {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.290428 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.290643 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.290756 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.290945 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.291063 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.291177 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.291298 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.291415 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.291537 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.291653 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.291803 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.291921 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.292035 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.292149 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.292271 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.292389 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.292503 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.292631 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.292747 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.292861 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.292988 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.293104 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.293218 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.293338 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.293449 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.293562 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.293674 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.293799 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.293926 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.294042 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.294161 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.294277 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.294390 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.294505 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.294628 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.294749 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.294865 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.294979 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.295094 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.295214 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.295338 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.295459 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.295576 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.295691 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.295805 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.295920 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.296042 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.296158 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.296281 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.296397 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.296516 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.296691 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.296820 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.296938 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] auth.external = None {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.296938 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] auth.mapped = None {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.297152 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.297152 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] auth.external = None {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.297365 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.297489 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] auth.mapped = None {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.297631 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.297631 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] auth.password = None {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.297870 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.298005 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] auth.token = None {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.298201 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.298318 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.298433 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] auth.password = None {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.298557 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] catalog.caching = True {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.298676 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] auth.token = None {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.298792 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.298914 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.299030 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.299154 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] catalog.caching = True {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.299271 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.299392 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.299522 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.299726 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.299848 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.299972 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.300090 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] credential.caching = True {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.300205 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.300321 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] credential.driver = sql {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.300435 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.300550 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.300690 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] credential.caching = True {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.300809 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.300924 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] credential.driver = sql {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.301038 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.301160 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.301276 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.301400 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.301517 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.301632 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.301747 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.301862 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.301977 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.302100 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.302217 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.302332 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.302446 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.302560 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.302674 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.302796 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.302914 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.303029 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.303144 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.303258 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.303373 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.303500 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.303618 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.303733 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.303848 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] federation.caching = True {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.303968 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.304159 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.304356 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.304562 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] federation.driver = sql {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.304739 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] federation.caching = True {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.304867 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.304984 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.305100 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.305300 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] federation.driver = sql {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.305460 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.305581 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.305697 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.305818 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.305935 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.306059 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.306177 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.306292 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.306414 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.306537 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.306655 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.306779 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.306896 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.307011 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.307127 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] identity.caching = True {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.307247 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.307363 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.307489 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.307607 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.307723 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] identity.caching = True {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.307838 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.307954 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.308069 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.308194 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.308311 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] identity.driver = sql {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.308426 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.308541 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.308678 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.308794 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.308922 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] identity.driver = sql {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.309040 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.309155 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.309273 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.309388 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.309511 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.309629 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.309744 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.309744 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.309958 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.310072 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.310195 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.310319 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.310436 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.310436 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.310652 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.310767 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.310889 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.311006 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.311121 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.311237 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.311352 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.311467 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.311590 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.311590 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.311808 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.311923 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.312039 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.312153 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.312276 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.312395 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.312509 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.312694 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.312813 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.312928 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.313059 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.313177 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.313293 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.313409 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.313524 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.313638 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.313761 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.313878 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.313993 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.314114 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.314231 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.314346 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.314471 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.314588 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.314702 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.314816 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.314931 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.315044 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.315167 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.315283 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.315406 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.315524 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] ldap.password = **** {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.315638 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.315753 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.315875 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.315993 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.316107 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.316228 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.316344 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] ldap.password = **** {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.316459 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.316583 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.316896 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.316995 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.317110 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.317224 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.317339 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.317465 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.317584 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.317699 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.317813 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.317927 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.318042 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.318165 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.318282 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.318397 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.318510 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.318626 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.318741 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.318864 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.318986 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.319102 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.319220 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] ldap.user = None {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.319423 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.319538 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.320143 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.320262 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.320384 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.320500 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.320677 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] ldap.user = None {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.320796 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.320923 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.321040 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.321298 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.321415 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.321530 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.321651 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.321776 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.321877 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.321975 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.322071 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.322186 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.322309 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.322432 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.322547 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.322662 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.322775 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.322890 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.323013 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.323013 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.323230 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.323344 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.323457 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.323571 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.323693 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.323809 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.323924 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.324038 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.324151 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.324266 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.324388 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.324504 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.324633 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.324750 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.324865 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.324980 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.325107 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.325225 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.325339 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.325454 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.325568 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.325683 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.325805 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.325921 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.326037 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.326151 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] policy.driver = sql {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.326265 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.326437 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.326643 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.326793 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.326911 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.327027 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.327142 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.327255 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] receipt.caching = True {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.327379 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] policy.driver = sql {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.327496 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.327611 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.327725 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.327839 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.327953 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.328076 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.328194 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.328315 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] receipt.caching = True {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.328431 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.328546 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.328678 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] resource.caching = True {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.328875 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.328994 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.329143 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.329336 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] resource.driver = sql {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.329336 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.329693 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.329693 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.330027 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.330146 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] resource.caching = True {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.330261 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.330375 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.330375 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] resource.driver = sql {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.330605 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] revoke.caching = True {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.330723 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.330723 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.330939 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.331054 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.331054 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] revoke.caching = True {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.331277 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.331394 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.331508 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] role.cache_time = None {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.331623 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.331738 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] role.caching = True {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.331853 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] role.cache_time = None {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.331976 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] role.driver = sql {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.332092 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] role.caching = True {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.332206 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] role.list_limit = None {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.332321 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] role.driver = sql {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.332436 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.332550 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] role.list_limit = None {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.332716 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.332836 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.332950 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.333064 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.333179 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.333296 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.333417 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.333540 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.333664 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.333779 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.333893 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.334006 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.334128 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.334244 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.334360 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.334473 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.334587 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.334709 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.334825 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.334940 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.335053 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.335168 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.335851 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.335986 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.336153 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.336316 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.336434 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.336549 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.336679 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.336798 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.336916 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.337030 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.337145 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.337259 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.337374 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.337503 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.337621 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.337735 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.337849 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.337964 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.338078 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.338201 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.338317 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.338317 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.338533 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.338648 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.338761 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.338883 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.339099 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.339099 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.339320 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.339435 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.339550 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.339675 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.339795 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.339911 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.340026 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.340141 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.340255 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.340378 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.340495 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] token.cache_time = None {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.340672 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.340791 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] token.caching = True {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.340907 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] token.cache_time = None {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.341035 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.341154 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] token.caching = True {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.341268 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] token.provider = fernet {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.341383 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.341498 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.341613 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] token.provider = fernet {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.341737 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.341855 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.341970 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.342085 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.342200 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.342315 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.342439 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.342556 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.342671 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.342787 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.342901 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] trust.driver = sql {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.343016 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.343139 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.343256 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] trust.driver = sql {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.343372 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.343487 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.343603 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.343718 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.343842 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.343960 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.344075 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.344190 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.344305 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.344420 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.344542 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.344674 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.344791 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.344907 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.345022 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] database.connection = **** {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.345150 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.345281 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.345398 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] database.connection = **** {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.345526 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.345655 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.345772 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.345889 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.346004 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.346118 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.346233 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.346355 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.346473 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.346587 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.346701 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.346816 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.346931 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.347054 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.347171 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.347285 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.347400 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.347515 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.347629 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.347752 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.347868 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.347984 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.348098 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.348290 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.348408 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.348620 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.348741 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.348857 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.348971 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.348971 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.349188 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.349315 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.349432 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.349546 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87173) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 27 08:25:39.349661 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.349661 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 08:25:39.349661 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 27 08:25:39.378124 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=87173) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 08:25:39.378333 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=87173) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 08:25:39.378551 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=87173) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 08:25:39.379361 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=87172) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 08:25:39.379596 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=87172) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 08:25:39.379821 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=87172) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 08:25:39.388061 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=87173) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 08:25:39.389496 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=87172) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 08:25:39.417569 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=87173) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 08:25:39.417777 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=87173) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 08:25:39.419684 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=87172) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 08:25:39.419915 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=87172) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 08:25:39.473258 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=87173) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 08:25:39.477067 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=87172) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 08:25:39.525733 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=87173) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 08:25:39.525963 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=87173) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 08:25:39.527946 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=87172) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 08:25:39.528183 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=87172) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 08:25:39.593870 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87173) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 08:25:39.594094 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=87173) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 08:25:39.594187 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87172) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 08:25:39.594316 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=87173) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 08:25:39.594405 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=87172) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 08:25:39.594531 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=87173) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 08:25:39.594616 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=87172) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 08:25:39.594744 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=87173) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 08:25:39.594844 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=87172) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 08:25:39.594954 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=87173) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 08:25:39.595038 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=87172) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 08:25:39.595229 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=87172) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 08:25:39.620336 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87173) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 08:25:39.620619 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=87173) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 08:25:39.620719 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87172) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 08:25:39.620802 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=87173) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 08:25:39.620937 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=87172) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 08:25:39.621019 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=87173) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 08:25:39.621147 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=87172) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 08:25:39.621246 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=87173) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 08:25:39.621369 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=87172) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 08:25:39.621451 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=87173) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 08:25:39.621582 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=87172) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 08:25:39.621666 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87173) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 08:25:39.621797 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=87172) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 08:25:39.622008 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87172) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 08:25:39.635679 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=87173) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 08:25:39.635885 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=87172) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 08:25:39.646480 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87173) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 08:25:39.646764 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=87173) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 08:25:39.647217 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=87173) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 08:25:39.647307 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87172) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 08:25:39.647385 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=87173) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 08:25:39.647458 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=87172) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 08:25:39.647547 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=87173) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 08:25:39.647625 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=87172) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 08:25:39.647697 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=87173) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 08:25:39.647824 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=87172) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 08:25:39.647903 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87173) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 08:25:39.647986 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=87172) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 08:25:39.648061 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=87172) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 08:25:39.648232 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87172) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 27 08:25:39.665649 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=87173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.665836 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=87173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 27 08:25:39.666169 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=87173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.666311 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=87172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.666441 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=87173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 27 08:25:39.666583 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=87172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 27 08:25:39.666712 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=87173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.666840 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=87172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.666978 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=87173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.667106 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=87172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 27 08:25:39.667233 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=87172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.667359 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=87173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.667518 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=87173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.667654 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=87172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.667811 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=87172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.668071 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=87172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.678310 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=87173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.678579 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=87173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.678840 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=87173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.679471 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=87172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.679669 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=87173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.679923 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=87172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.680198 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=87172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.680481 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=87172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.687775 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=87173) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 08:25:39.688682 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=87172) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 08:25:39.691185 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=87173) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 08:25:39.691454 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=87173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.691735 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=87173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.692004 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=87173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.692088 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=87172) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 08:25:39.692277 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=87173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.692360 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=87172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.692528 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=87173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.692641 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=87172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.692814 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=87173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.692898 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=87172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.693079 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=87173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.693161 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=87172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.693340 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=87173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.693428 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=87172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.693605 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=87173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.693685 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=87172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.693865 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=87173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.693950 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=87172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.694177 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=87172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.694448 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=87172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.694898 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=87172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.721079 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=87173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.722474 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=87172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.722746 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=87173) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 08:25:39.723022 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=87173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.724225 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=87172) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 08:25:39.724460 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=87172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.729141 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=87173) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 08:25:39.729431 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=87173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.729711 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=87173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.730606 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=87172) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 08:25:39.730899 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=87172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.731180 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=87172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.737373 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=87173) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 08:25:39.737665 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=87173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.738891 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=87172) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 08:25:39.739196 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=87172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.742417 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=87173) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 08:25:39.742709 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=87173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.742986 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=87173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.743263 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=87173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.743533 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=87173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.743800 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=87173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.744062 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=87173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.744214 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=87172) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 08:25:39.744310 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=87173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.744520 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=87172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.744831 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=87172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.745116 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=87172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.745393 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=87172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.745671 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=87172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.745942 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=87172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.746211 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=87172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.763487 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=87173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.763772 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=87173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.765389 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=87172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.765684 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=87172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.768551 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=87173) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 08:25:39.770480 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=87172) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 08:25:39.772409 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=87173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.773258 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=87173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.775085 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=87172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.775402 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=87172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.778469 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=87173) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 08:25:39.780656 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=87172) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 08:25:39.782348 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=87173) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 08:25:39.784552 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=87172) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 08:25:39.786120 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=87173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.786424 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=87173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.786702 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=87173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.786989 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=87173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.787272 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=87173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.787551 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=87173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.789271 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=87172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.789673 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=87172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.789953 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=87172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.790240 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=87172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.790519 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=87172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.790812 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=87172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.807811 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=87173) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 08:25:39.808103 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=87173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.808366 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=87173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.808643 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=87173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.810620 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=87172) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 08:25:39.810922 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=87172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.811286 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=87172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.811457 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=87172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.817395 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=87173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.819276 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=87173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.819571 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=87173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.820145 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=87172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.821997 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=87172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.822278 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=87172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.822774 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=87173) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 08:25:39.823069 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=87173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.823347 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=87173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.823619 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=87173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.824034 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=87173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.825456 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=87172) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 08:25:39.825751 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=87172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.826038 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=87172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.826329 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=87172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.826754 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=87172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.838305 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=87173) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 08:25:39.838591 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=87173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.838866 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=87173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.839138 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=87173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.839411 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=87173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.839697 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=87173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.839977 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=87173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.840912 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=87172) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 08:25:39.841213 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=87172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.841495 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=87172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.841775 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=87172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.842055 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=87172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.842339 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=87172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.842617 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=87172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.858711 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=87173) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 08:25:39.863931 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=87172) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 08:25:39.864113 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=87173) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 08:25:39.864815 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=87172) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 08:25:39.865890 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=87173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.867593 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=87173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.868278 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=87172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.869252 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=87173) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 08:25:39.869974 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=87172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.871663 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=87173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.871663 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=87173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.871917 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=87172) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 08:25:39.873430 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=87172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.873734 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=87172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.878687 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=87173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.880293 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=87173) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 08:25:39.881199 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=87172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.883350 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=87172) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 08:25:39.884327 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=87173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.884633 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=87173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.884920 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=87173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.885188 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=87173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.886841 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=87172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.887138 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=87172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.887428 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=87172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.887752 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=87172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.894734 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=87173) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 08:25:39.895021 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=87173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.895296 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=87173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.897160 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=87172) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 08:25:39.897452 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=87172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.898376 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=87172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.903704 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=87173) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 08:25:39.903983 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=87173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.904262 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=87173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.904531 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=87173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.904823 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=87173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.905093 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=87173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.905367 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=87173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.905626 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=87173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.905895 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=87173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.906174 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=87173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.906443 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=87172) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 27 08:25:39.906535 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=87173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.906725 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=87172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.906806 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=87173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.907005 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=87172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.907143 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=87173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.907271 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=87173) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.907352 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=87172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.907541 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=87172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.907811 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=87172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.908091 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=87172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.908363 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=87172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.908668 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=87172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.908954 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=87172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.909328 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=87172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.909592 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=87172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.909867 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=87172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.910129 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=87172) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 27 08:25:39.946145 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56204916d9c0 pid: 87173 (default app) May 27 08:25:39.949337 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56204916d9c0 pid: 87172 (default app) May 27 08:25:39.949607 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a3e969-f7e2-4bb9-bfd4-e57bb84e8ac7 None None] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:25:39.949897 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a3e969-f7e2-4bb9-bfd4-e57bb84e8ac7 None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:25:39.950174 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a3e969-f7e2-4bb9-bfd4-e57bb84e8ac7 None None] PATH_INFO: `/v3` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:25:39.954424 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 1/1] 10.222.0.62 () {50 vars in 791 bytes} [Fri May 27 08:25:39 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:25:48.304287 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff286d7-e617-4fd1-9155-9252f1a3c2e9 None None] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:25:48.304869 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff286d7-e617-4fd1-9155-9252f1a3c2e9 None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:25:48.304869 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff286d7-e617-4fd1-9155-9252f1a3c2e9 None None] PATH_INFO: `/` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:25:48.309316 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 1/2] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:25:48 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:25:48.314602 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb682948-5e2d-45cf-be24-d5c2905203d5 None None] REQUEST_METHOD: `POST` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:25:48.315029 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb682948-5e2d-45cf-be24-d5c2905203d5 None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:25:48.315189 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb682948-5e2d-45cf-be24-d5c2905203d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:25:48.389972 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: INFO dbcounter [None req-eb682948-5e2d-45cf-be24-d5c2905203d5 None None] Registered counter for database keystone May 27 08:25:48.411609 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG oslo_db.sqlalchemy.engines [None req-eb682948-5e2d-45cf-be24-d5c2905203d5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87173) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 08:25:48.418746 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writer thread running {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 08:25:48.708621 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG passlib.handlers.bcrypt [None req-eb682948-5e2d-45cf-be24-d5c2905203d5 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=87173) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 27 08:25:48.709302 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG passlib.handlers.bcrypt [None req-eb682948-5e2d-45cf-be24-d5c2905203d5 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=87173) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 27 08:25:48.766391 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.auth.core [None req-eb682948-5e2d-45cf-be24-d5c2905203d5 None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:25:48.768045 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.fernet_utils [None req-eb682948-5e2d-45cf-be24-d5c2905203d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:25:48.895653 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 2/3] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:25:48 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 582 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 27 08:25:49.062898 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff286d7-e617-4fd1-9155-9252f1a3c2e9 None None] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:25:49.138069 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: INFO dbcounter [None req-dff286d7-e617-4fd1-9155-9252f1a3c2e9 None None] Registered counter for database keystone May 27 08:25:49.157488 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG oslo_db.sqlalchemy.engines [None req-dff286d7-e617-4fd1-9155-9252f1a3c2e9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87172) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 08:25:49.164478 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writer thread running {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 08:25:49.286925 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff286d7-e617-4fd1-9155-9252f1a3c2e9 None None] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:25:49.291759 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9473335a-47ee-441a-a438-3e1e64209cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db9f476e682c4ed795ebf3f955e975c9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:25:49.292435 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9473335a-47ee-441a-a438-3e1e64209cf1 admin admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:25:49.292754 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9473335a-47ee-441a-a438-3e1e64209cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:25:49.293039 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9473335a-47ee-441a-a438-3e1e64209cf1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:25:49.301322 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9473335a-47ee-441a-a438-3e1e64209cf1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:25:49.457079 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: WARNING keystone.common.rbac_enforcer.enforcer [None req-9473335a-47ee-441a-a438-3e1e64209cf1 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 27 08:25:49.457689 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9473335a-47ee-441a-a438-3e1e64209cf1 admin admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:25:49.470857 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 2/4] 10.222.0.62 () {58 vars in 1324 bytes} [Fri May 27 08:25:49 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 27 08:25:49.477582 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb682948-5e2d-45cf-be24-d5c2905203d5 None None] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:25:49.492020 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb682948-5e2d-45cf-be24-d5c2905203d5 None None] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:25:49.496532 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58ba100-0882-4745-a2a7-f71aebd8dbc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db9f476e682c4ed795ebf3f955e975c9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:25:49.497680 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58ba100-0882-4745-a2a7-f71aebd8dbc7 admin admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:25:49.497971 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58ba100-0882-4745-a2a7-f71aebd8dbc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:25:49.498251 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58ba100-0882-4745-a2a7-f71aebd8dbc7 admin admin] PATH_INFO: `/v3/projects/db9f476e682c4ed795ebf3f955e975c9` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:25:49.499769 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58ba100-0882-4745-a2a7-f71aebd8dbc7 admin admin] RBAC: Authorizing `identity:get_project(project_id=db9f476e682c4ed795ebf3f955e975c9)` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:25:49.554165 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: WARNING keystone.common.rbac_enforcer.enforcer [None req-e58ba100-0882-4745-a2a7-f71aebd8dbc7 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 27 08:25:49.554749 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58ba100-0882-4745-a2a7-f71aebd8dbc7 admin admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:25:49.562476 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 3/5] 10.222.0.62 () {56 vars in 1207 bytes} [Fri May 27 08:25:49 2022] GET /identity/v3/projects/db9f476e682c4ed795ebf3f955e975c9 => generated 344 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:25:51.845793 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e92b90-15c6-453f-ba64-f09fdc5c2c4a None None] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:25:51.846336 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e92b90-15c6-453f-ba64-f09fdc5c2c4a None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:25:51.846336 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e92b90-15c6-453f-ba64-f09fdc5c2c4a None None] PATH_INFO: `/` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:25:51.851190 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 3/6] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:25:51 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:25:51.856946 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fe611e-14b1-4330-b2a7-673ce16affad None None] REQUEST_METHOD: `POST` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:25:51.857350 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fe611e-14b1-4330-b2a7-673ce16affad None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:25:51.857499 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fe611e-14b1-4330-b2a7-673ce16affad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:25:51.877097 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.auth.core [None req-c8fe611e-14b1-4330-b2a7-673ce16affad None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:25:51.878680 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.fernet_utils [None req-c8fe611e-14b1-4330-b2a7-673ce16affad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:25:51.889445 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 4/7] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:25:51 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 27 08:25:51.914883 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e92b90-15c6-453f-ba64-f09fdc5c2c4a None None] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:25:51.926976 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e92b90-15c6-453f-ba64-f09fdc5c2c4a None None] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:25:51.931593 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0749ea5e-eb4e-4c0a-bd41-f8b55dfc9146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db9f476e682c4ed795ebf3f955e975c9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:25:51.932227 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0749ea5e-eb4e-4c0a-bd41-f8b55dfc9146 admin admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:25:51.932514 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0749ea5e-eb4e-4c0a-bd41-f8b55dfc9146 admin admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:25:51.932824 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0749ea5e-eb4e-4c0a-bd41-f8b55dfc9146 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:25:51.940657 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0749ea5e-eb4e-4c0a-bd41-f8b55dfc9146 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:25:51.943690 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0749ea5e-eb4e-4c0a-bd41-f8b55dfc9146 admin admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:25:51.954472 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 4/8] 10.222.0.62 () {58 vars in 1324 bytes} [Fri May 27 08:25:51 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 27 08:25:51.961944 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fe611e-14b1-4330-b2a7-673ce16affad None None] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:25:51.971117 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fe611e-14b1-4330-b2a7-673ce16affad None None] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:25:51.976207 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384e3a7b-ce3c-498e-abd6-664bac47dd19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db9f476e682c4ed795ebf3f955e975c9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:25:51.977132 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384e3a7b-ce3c-498e-abd6-664bac47dd19 admin admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:25:51.977422 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384e3a7b-ce3c-498e-abd6-664bac47dd19 admin admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:25:51.977701 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384e3a7b-ce3c-498e-abd6-664bac47dd19 admin admin] PATH_INFO: `/v3/users/ca179b0a3ab4467ba61f4e713c6eb763` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:25:51.979132 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384e3a7b-ce3c-498e-abd6-664bac47dd19 admin admin] RBAC: Authorizing `identity:get_user(user_id=ca179b0a3ab4467ba61f4e713c6eb763)` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:25:51.981023 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384e3a7b-ce3c-498e-abd6-664bac47dd19 admin admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:25:51.982674 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 5/9] 10.222.0.62 () {56 vars in 1198 bytes} [Fri May 27 08:25:51 2022] GET /identity/v3/users/ca179b0a3ab4467ba61f4e713c6eb763 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:25:54.375531 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cc1adb-8d40-43f8-95d1-bf463723dcaa None None] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:25:54.376084 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cc1adb-8d40-43f8-95d1-bf463723dcaa None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:25:54.376084 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cc1adb-8d40-43f8-95d1-bf463723dcaa None None] PATH_INFO: `/` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:25:54.377494 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 5/10] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:25:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:25:54.383252 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0804dbe-f48c-4405-bf4d-5a61e5656477 None None] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:25:54.383693 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0804dbe-f48c-4405-bf4d-5a61e5656477 None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:25:54.383780 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a471b22-3dc0-4972-aa26-72e83b66ae8c None None] REQUEST_METHOD: `POST` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:25:54.383875 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0804dbe-f48c-4405-bf4d-5a61e5656477 None None] PATH_INFO: `/` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:25:54.383959 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a471b22-3dc0-4972-aa26-72e83b66ae8c None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:25:54.384243 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a471b22-3dc0-4972-aa26-72e83b66ae8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:25:54.385228 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 6/11] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:25:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 08:25:54.390316 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f817647-dd95-4792-9f63-17bb06dd8d37 None None] REQUEST_METHOD: `POST` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:25:54.390606 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f817647-dd95-4792-9f63-17bb06dd8d37 None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:25:54.390890 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f817647-dd95-4792-9f63-17bb06dd8d37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:25:54.407201 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.auth.core [None req-7f817647-dd95-4792-9f63-17bb06dd8d37 None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:25:54.408382 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.fernet_utils [None req-7f817647-dd95-4792-9f63-17bb06dd8d37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:25:54.424618 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG passlib.handlers.bcrypt [None req-9a471b22-3dc0-4972-aa26-72e83b66ae8c None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=87172) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 27 08:25:54.425060 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG passlib.handlers.bcrypt [None req-9a471b22-3dc0-4972-aa26-72e83b66ae8c None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=87172) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 27 08:25:54.471702 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.auth.core [None req-9a471b22-3dc0-4972-aa26-72e83b66ae8c None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:25:54.473356 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.fernet_utils [None req-9a471b22-3dc0-4972-aa26-72e83b66ae8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:25:54.489272 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 7/12] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:25:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 08:25:54.515429 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f817647-dd95-4792-9f63-17bb06dd8d37 None None] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:25:54.544581 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:25:54.581522 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 6/13] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:25:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 08:25:54.605677 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a471b22-3dc0-4972-aa26-72e83b66ae8c None None] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:25:54.629090 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f817647-dd95-4792-9f63-17bb06dd8d37 None None] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:25:54.670824 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e855285e-db49-4d11-a7bc-024c06443317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:25:54.672342 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e855285e-db49-4d11-a7bc-024c06443317 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:25:54.673659 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e855285e-db49-4d11-a7bc-024c06443317 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:25:54.673957 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e855285e-db49-4d11-a7bc-024c06443317 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:25:54.689060 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e855285e-db49-4d11-a7bc-024c06443317 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 08:25:54.704012 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application [None req-e855285e-db49-4d11-a7bc-024c06443317 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 08:25:54.704012 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:25:54.704012 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:25:54.704012 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:25:54.704012 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:25:54.704012 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:25:54.704012 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:25:54.704012 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:25:54.704012 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:25:54.704012 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:25:54.704012 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:25:54.704012 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:25:54.704012 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 08:25:54.704012 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 08:25:54.704012 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 08:25:54.704012 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 08:25:54.705161 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 08:25:54.705161 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 08:25:54.705161 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 08:25:54.705161 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 08:25:54.705161 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:25:54.705161 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:25:54.705161 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:25:54.705161 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:25:54.705161 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:25:54.705161 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:25:54.705161 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:25:54.705161 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application with Lock( May 27 08:25:54.705161 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:25:54.705161 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._enter() May 27 08:25:54.705161 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:25:54.705161 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:25:54.706040 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:25:54.706040 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.creator() May 27 08:25:54.706040 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:25:54.706040 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application created_value = creator( May 27 08:25:54.706040 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 08:25:54.706040 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 08:25:54.706040 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 08:25:54.706040 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 08:25:54.706040 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 08:25:54.706040 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 08:25:54.706040 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 08:25:54.706040 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application May 27 08:25:54.707232 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 8/14] 10.222.0.62 () {56 vars in 1096 bytes} [Fri May 27 08:25:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 08:25:54.713867 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e855285e-db49-4d11-a7bc-024c06443317 None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:25:54.726016 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a471b22-3dc0-4972-aa26-72e83b66ae8c None None] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:25:54.728018 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:25:54.765704 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339a1be5-972f-4463-b0eb-babe2e522813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:25:54.766637 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339a1be5-972f-4463-b0eb-babe2e522813 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:25:54.767088 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339a1be5-972f-4463-b0eb-babe2e522813 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:25:54.767529 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339a1be5-972f-4463-b0eb-babe2e522813 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:25:54.814966 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:25:54.838020 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e855285e-db49-4d11-a7bc-024c06443317 None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:25:54.857370 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339a1be5-972f-4463-b0eb-babe2e522813 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:25:54.858928 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339a1be5-972f-4463-b0eb-babe2e522813 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:25:54.877753 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18c0987-f4db-4697-a275-d5c09e0bd5f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:25:54.878451 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18c0987-f4db-4697-a275-d5c09e0bd5f0 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:25:54.878735 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18c0987-f4db-4697-a275-d5c09e0bd5f0 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:25:54.879014 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18c0987-f4db-4697-a275-d5c09e0bd5f0 None admin] PATH_INFO: `/v3/roles` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:25:54.879839 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18c0987-f4db-4697-a275-d5c09e0bd5f0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:25:54.880096 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18c0987-f4db-4697-a275-d5c09e0bd5f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:25:54.882159 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18c0987-f4db-4697-a275-d5c09e0bd5f0 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:25:54.896359 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 9/15] 10.222.0.62 () {56 vars in 1099 bytes} [Fri May 27 08:25:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 08:25:54.903818 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18c0987-f4db-4697-a275-d5c09e0bd5f0 None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:25:54.979955 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 7/16] 10.222.0.62 () {58 vars in 1282 bytes} [Fri May 27 08:25:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 27 08:25:54.987127 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339a1be5-972f-4463-b0eb-babe2e522813 None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:25:54.990974 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:25:55.019436 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18c0987-f4db-4697-a275-d5c09e0bd5f0 None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:25:55.054649 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f4ce94-bddc-4581-bf74-c197eb00a70f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:25:55.055524 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f4ce94-bddc-4581-bf74-c197eb00a70f None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:25:55.055807 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f4ce94-bddc-4581-bf74-c197eb00a70f None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:25:55.056080 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f4ce94-bddc-4581-bf74-c197eb00a70f None admin] PATH_INFO: `/v3/users/ca179b0a3ab4467ba61f4e713c6eb763` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:25:55.057304 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f4ce94-bddc-4581-bf74-c197eb00a70f None admin] RBAC: Authorizing `identity:get_user(user_id=ca179b0a3ab4467ba61f4e713c6eb763)` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:25:55.058808 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f4ce94-bddc-4581-bf74-c197eb00a70f None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:25:55.060481 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 10/17] 10.222.0.62 () {56 vars in 1177 bytes} [Fri May 27 08:25:54 2022] GET /identity/v3/users/ca179b0a3ab4467ba61f4e713c6eb763 => generated 247 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 08:25:55.066347 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f4ce94-bddc-4581-bf74-c197eb00a70f None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:25:55.082600 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:25:55.103630 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339a1be5-972f-4463-b0eb-babe2e522813 None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:25:55.143187 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6794eae1-9855-4e1b-9aab-6e042fabb1ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:25:55.143913 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6794eae1-9855-4e1b-9aab-6e042fabb1ce None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:25:55.144199 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6794eae1-9855-4e1b-9aab-6e042fabb1ce None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:25:55.144481 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6794eae1-9855-4e1b-9aab-6e042fabb1ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:25:55.171098 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6794eae1-9855-4e1b-9aab-6e042fabb1ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:25:55.172723 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6794eae1-9855-4e1b-9aab-6e042fabb1ce None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:25:55.187586 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f4ce94-bddc-4581-bf74-c197eb00a70f None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:25:55.196182 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application [None req-6794eae1-9855-4e1b-9aab-6e042fabb1ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 08:25:55.196182 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:25:55.196182 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:25:55.196182 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:25:55.196182 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:25:55.196182 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:25:55.196182 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:25:55.196182 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:25:55.196182 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:25:55.196182 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:25:55.196182 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:25:55.196182 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:25:55.196182 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 08:25:55.196182 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 08:25:55.196182 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 08:25:55.197135 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 08:25:55.197135 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:25:55.197135 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:25:55.197135 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:25:55.197135 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:25:55.197135 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:25:55.197135 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:25:55.197135 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:25:55.197135 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application with Lock( May 27 08:25:55.197135 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:25:55.197135 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._enter() May 27 08:25:55.197135 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:25:55.197135 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:25:55.197135 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:25:55.197135 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.creator() May 27 08:25:55.197135 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:25:55.197135 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application created_value = creator( May 27 08:25:55.197942 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 08:25:55.197942 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 08:25:55.197942 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 08:25:55.197942 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application May 27 08:25:55.198160 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 8/18] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 08:25:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 08:25:55.205443 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6794eae1-9855-4e1b-9aab-6e042fabb1ce None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:25:55.231331 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3028e7-2ce9-46cb-9dd3-7003974f0934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:25:55.232135 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3028e7-2ce9-46cb-9dd3-7003974f0934 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:25:55.232474 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3028e7-2ce9-46cb-9dd3-7003974f0934 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:25:55.232780 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3028e7-2ce9-46cb-9dd3-7003974f0934 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:25:55.234076 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3028e7-2ce9-46cb-9dd3-7003974f0934 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:25:55.235473 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3028e7-2ce9-46cb-9dd3-7003974f0934 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:25:55.237281 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 11/19] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 08:25:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 08:25:55.244081 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3028e7-2ce9-46cb-9dd3-7003974f0934 None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:25:55.271809 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:25:55.328654 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6794eae1-9855-4e1b-9aab-6e042fabb1ce None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:25:55.334203 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:25:55.358913 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3028e7-2ce9-46cb-9dd3-7003974f0934 None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:25:55.375591 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d247ec1-7828-48a8-96ea-3749fe91ef81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:25:55.376610 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d247ec1-7828-48a8-96ea-3749fe91ef81 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:25:55.376917 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d247ec1-7828-48a8-96ea-3749fe91ef81 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:25:55.377206 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d247ec1-7828-48a8-96ea-3749fe91ef81 None admin] PATH_INFO: `/v3/domains` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:25:55.378530 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d247ec1-7828-48a8-96ea-3749fe91ef81 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:25:55.378848 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d247ec1-7828-48a8-96ea-3749fe91ef81 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:25:55.380280 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d247ec1-7828-48a8-96ea-3749fe91ef81 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:25:55.399707 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed71e88-3658-41c1-8b9e-6c9df4b1dc92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:25:55.400281 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed71e88-3658-41c1-8b9e-6c9df4b1dc92 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:25:55.400568 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed71e88-3658-41c1-8b9e-6c9df4b1dc92 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:25:55.401081 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 9/20] 10.222.0.62 () {56 vars in 1109 bytes} [Fri May 27 08:25:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 08:25:55.401193 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed71e88-3658-41c1-8b9e-6c9df4b1dc92 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:25:55.401745 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed71e88-3658-41c1-8b9e-6c9df4b1dc92 None admin] RBAC: Adding query filter params (role.id=5e6f243a7201412c965e7c70249d4dc0, scope.domain.id=default, user.id=ca179b0a3ab4467ba61f4e713c6eb763) {{(pid=87173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:25:55.402055 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed71e88-3658-41c1-8b9e-6c9df4b1dc92 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:25:55.403706 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed71e88-3658-41c1-8b9e-6c9df4b1dc92 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:25:55.413510 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 12/21] 10.222.0.62 () {56 vars in 1322 bytes} [Fri May 27 08:25:55 2022] GET /identity/v3/role_assignments?user.id=ca179b0a3ab4467ba61f4e713c6eb763&scope.domain.id=default&role.id=5e6f243a7201412c965e7c70249d4dc0 => generated 233 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:25:58.140737 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04277cfb-32bb-45d6-bcd6-ee25ca3a95f5 None None] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:25:58.141809 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04277cfb-32bb-45d6-bcd6-ee25ca3a95f5 None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:25:58.142308 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04277cfb-32bb-45d6-bcd6-ee25ca3a95f5 None None] PATH_INFO: `/` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:25:58.144453 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 10/22] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:25:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:25:58.150097 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db250ce3-dc1c-4ae7-887d-f4868c99dc04 None None] REQUEST_METHOD: `POST` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:25:58.151122 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db250ce3-dc1c-4ae7-887d-f4868c99dc04 None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:25:58.151607 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db250ce3-dc1c-4ae7-887d-f4868c99dc04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:25:58.176501 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.auth.core [None req-db250ce3-dc1c-4ae7-887d-f4868c99dc04 None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:25:58.178664 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.fernet_utils [None req-db250ce3-dc1c-4ae7-887d-f4868c99dc04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:25:58.275027 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 13/23] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:25:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 08:25:58.334548 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04277cfb-32bb-45d6-bcd6-ee25ca3a95f5 None None] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:25:58.369849 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6120ad44-83dd-41ed-8012-283a41b1f96c None None] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:25:58.370495 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6120ad44-83dd-41ed-8012-283a41b1f96c None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:25:58.370979 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6120ad44-83dd-41ed-8012-283a41b1f96c None None] PATH_INFO: `/` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:25:58.372543 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 14/24] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:25:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 08:25:58.377723 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945fc0de-b78b-4d9f-827f-0d3c0a4b88aa None None] REQUEST_METHOD: `POST` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:25:58.378241 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945fc0de-b78b-4d9f-827f-0d3c0a4b88aa None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:25:58.378731 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945fc0de-b78b-4d9f-827f-0d3c0a4b88aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:25:58.405433 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.auth.core [None req-945fc0de-b78b-4d9f-827f-0d3c0a4b88aa None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:25:58.408313 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.fernet_utils [None req-945fc0de-b78b-4d9f-827f-0d3c0a4b88aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:25:58.525370 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04277cfb-32bb-45d6-bcd6-ee25ca3a95f5 None None] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:25:58.545019 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:25:58.559168 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 15/25] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:25:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 08:25:58.560721 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3280670-3560-4ff1-b780-61189a362a1f None None] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:25:58.561014 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3280670-3560-4ff1-b780-61189a362a1f None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:25:58.561293 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3280670-3560-4ff1-b780-61189a362a1f None None] PATH_INFO: `/` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:25:58.562564 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 16/26] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:25:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:25:58.574027 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dc3a63-da3f-46a6-91c2-aa2c35c76993 None None] REQUEST_METHOD: `POST` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:25:58.574319 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dc3a63-da3f-46a6-91c2-aa2c35c76993 None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:25:58.574597 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dc3a63-da3f-46a6-91c2-aa2c35c76993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:25:58.588245 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc14945-441d-479d-bbcf-ef520994f247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:25:58.589083 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc14945-441d-479d-bbcf-ef520994f247 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:25:58.589367 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc14945-441d-479d-bbcf-ef520994f247 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:25:58.589643 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc14945-441d-479d-bbcf-ef520994f247 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:25:58.592138 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:25:58.614129 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.auth.core [None req-95dc3a63-da3f-46a6-91c2-aa2c35c76993 None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:25:58.617144 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.fernet_utils [None req-95dc3a63-da3f-46a6-91c2-aa2c35c76993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:25:58.619551 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc14945-441d-479d-bbcf-ef520994f247 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:25:58.621451 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc14945-441d-479d-bbcf-ef520994f247 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:25:58.657517 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application [None req-edc14945-441d-479d-bbcf-ef520994f247 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 08:25:58.657517 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:25:58.657517 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:25:58.657517 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:25:58.657517 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:25:58.657517 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:25:58.657517 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:25:58.657517 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:25:58.657517 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:25:58.657517 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:25:58.657517 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:25:58.657517 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:25:58.657517 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 08:25:58.657517 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 08:25:58.657517 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 08:25:58.658484 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 08:25:58.658484 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:25:58.658484 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:25:58.658484 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:25:58.658484 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:25:58.658484 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:25:58.658484 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:25:58.658484 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:25:58.658484 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application with Lock( May 27 08:25:58.658484 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:25:58.658484 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._enter() May 27 08:25:58.658484 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:25:58.658484 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:25:58.658484 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:25:58.658484 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.creator() May 27 08:25:58.658484 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:25:58.658484 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application created_value = creator( May 27 08:25:58.659452 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 08:25:58.659452 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 08:25:58.659452 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 08:25:58.659452 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application May 27 08:25:58.659452 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 11/27] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 08:25:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 08:25:58.659452 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc14945-441d-479d-bbcf-ef520994f247 None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:25:58.751281 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 17/28] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:25:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 08:25:58.752236 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dc3a63-da3f-46a6-91c2-aa2c35c76993 None None] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:25:58.809982 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc14945-441d-479d-bbcf-ef520994f247 None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:25:58.853515 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a0c111-a478-41fb-8655-80517b62f459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:25:58.854593 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a0c111-a478-41fb-8655-80517b62f459 None admin] REQUEST_METHOD: `POST` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:25:58.855023 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a0c111-a478-41fb-8655-80517b62f459 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:25:58.855517 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a0c111-a478-41fb-8655-80517b62f459 None admin] PATH_INFO: `/v3/roles` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:25:58.856474 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a0c111-a478-41fb-8655-80517b62f459 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:25:58.858170 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a0c111-a478-41fb-8655-80517b62f459 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:25:58.900949 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dc3a63-da3f-46a6-91c2-aa2c35c76993 None None] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:25:58.946536 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f99123-dc28-4d70-9d91-3ef3f976a671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:25:58.947494 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f99123-dc28-4d70-9d91-3ef3f976a671 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:25:58.947935 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f99123-dc28-4d70-9d91-3ef3f976a671 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:25:58.948364 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f99123-dc28-4d70-9d91-3ef3f976a671 None admin] PATH_INFO: `/v3/domains` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:25:58.949339 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f99123-dc28-4d70-9d91-3ef3f976a671 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:25:58.949845 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f99123-dc28-4d70-9d91-3ef3f976a671 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:25:58.951541 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f99123-dc28-4d70-9d91-3ef3f976a671 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:25:58.953846 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:25:58.973953 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 18/29] 10.222.0.62 () {56 vars in 1109 bytes} [Fri May 27 08:25:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:25:58.975487 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f99123-dc28-4d70-9d91-3ef3f976a671 None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:25:59.036969 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 12/30] 10.222.0.62 () {60 vars in 1131 bytes} [Fri May 27 08:25:58 2022] POST /identity/v3/roles => generated 219 bytes in 378 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 08:25:59.039812 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc70d6e9-ae7d-4bca-8cf6-4f73f53052f8 None None] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:25:59.040108 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc70d6e9-ae7d-4bca-8cf6-4f73f53052f8 None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:25:59.040392 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc70d6e9-ae7d-4bca-8cf6-4f73f53052f8 None None] PATH_INFO: `/` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:25:59.042302 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 13/31] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:25:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:25:59.043261 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc70d6e9-ae7d-4bca-8cf6-4f73f53052f8 None None] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:25:59.083452 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:25:59.128823 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f99123-dc28-4d70-9d91-3ef3f976a671 None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:25:59.185963 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc70d6e9-ae7d-4bca-8cf6-4f73f53052f8 None None] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:25:59.220283 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e119db-0a43-46a9-a2a9-a6e2e2478cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:25:59.221756 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e119db-0a43-46a9-a2a9-a6e2e2478cb7 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:25:59.222254 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e119db-0a43-46a9-a2a9-a6e2e2478cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:25:59.222673 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e119db-0a43-46a9-a2a9-a6e2e2478cb7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:25:59.232039 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ddb65c-1efb-471e-b63d-df5ceed7bfe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:25:59.233416 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ddb65c-1efb-471e-b63d-df5ceed7bfe4 None admin] REQUEST_METHOD: `POST` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:25:59.233946 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ddb65c-1efb-471e-b63d-df5ceed7bfe4 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:25:59.234469 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ddb65c-1efb-471e-b63d-df5ceed7bfe4 None admin] PATH_INFO: `/v3/projects` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:25:59.235685 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ddb65c-1efb-471e-b63d-df5ceed7bfe4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:25:59.237774 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ddb65c-1efb-471e-b63d-df5ceed7bfe4 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:25:59.249604 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e119db-0a43-46a9-a2a9-a6e2e2478cb7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 08:25:59.259708 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application [None req-86e119db-0a43-46a9-a2a9-a6e2e2478cb7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 08:25:59.259708 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:25:59.259708 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:25:59.259708 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:25:59.259708 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:25:59.259708 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:25:59.259708 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:25:59.259708 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:25:59.259708 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:25:59.259708 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:25:59.259708 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:25:59.259708 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:25:59.259708 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 08:25:59.259708 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 08:25:59.259708 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 08:25:59.259708 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 08:25:59.260743 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 08:25:59.260743 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 08:25:59.260743 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 08:25:59.260743 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 08:25:59.260743 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:25:59.260743 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:25:59.260743 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:25:59.260743 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:25:59.260743 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:25:59.260743 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:25:59.260743 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:25:59.260743 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application with Lock( May 27 08:25:59.260743 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:25:59.260743 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._enter() May 27 08:25:59.260743 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:25:59.260743 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:25:59.261537 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:25:59.261537 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.creator() May 27 08:25:59.261537 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:25:59.261537 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application created_value = creator( May 27 08:25:59.261537 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 08:25:59.261537 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 08:25:59.261537 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 08:25:59.261537 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 08:25:59.261537 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 08:25:59.261537 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 08:25:59.261537 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 08:25:59.261537 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application May 27 08:25:59.262156 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 19/32] 10.222.0.62 () {56 vars in 1096 bytes} [Fri May 27 08:25:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 08:25:59.263768 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97aa04a-5f67-4a86-b89a-3d08f12cc3a2 None None] REQUEST_METHOD: `POST` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:25:59.263966 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97aa04a-5f67-4a86-b89a-3d08f12cc3a2 None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:25:59.264361 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97aa04a-5f67-4a86-b89a-3d08f12cc3a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:25:59.280319 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 14/33] 10.222.0.62 () {60 vars in 1141 bytes} [Fri May 27 08:25:59 2022] POST /identity/v3/projects => generated 301 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 08:25:59.281927 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ddb65c-1efb-471e-b63d-df5ceed7bfe4 None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:25:59.285372 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.auth.core [None req-d97aa04a-5f67-4a86-b89a-3d08f12cc3a2 None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:25:59.287415 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.fernet_utils [None req-d97aa04a-5f67-4a86-b89a-3d08f12cc3a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:25:59.394468 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:25:59.397483 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:25:59.420776 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ddb65c-1efb-471e-b63d-df5ceed7bfe4 None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:25:59.454303 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 20/34] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:25:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 08:25:59.464716 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed23c7b-1e91-448e-b914-e2d2702d56da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:25:59.465446 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed23c7b-1e91-448e-b914-e2d2702d56da None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:25:59.465739 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed23c7b-1e91-448e-b914-e2d2702d56da None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:25:59.466024 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed23c7b-1e91-448e-b914-e2d2702d56da None admin] PATH_INFO: `/v3/roles` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:25:59.466899 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed23c7b-1e91-448e-b914-e2d2702d56da None admin] RBAC: Adding query filter params (name=admin) {{(pid=87172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:25:59.467223 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed23c7b-1e91-448e-b914-e2d2702d56da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:25:59.468732 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed23c7b-1e91-448e-b914-e2d2702d56da None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:25:59.484301 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 15/35] 10.222.0.62 () {56 vars in 1099 bytes} [Fri May 27 08:25:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:25:59.491906 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97aa04a-5f67-4a86-b89a-3d08f12cc3a2 None None] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:25:59.501761 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed23c7b-1e91-448e-b914-e2d2702d56da None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:25:59.669819 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed23c7b-1e91-448e-b914-e2d2702d56da None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:25:59.680054 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97aa04a-5f67-4a86-b89a-3d08f12cc3a2 None None] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:25:59.718222 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13763647-1001-4d41-8a8a-ee112cd59f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:25:59.719112 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13763647-1001-4d41-8a8a-ee112cd59f93 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:25:59.719400 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13763647-1001-4d41-8a8a-ee112cd59f93 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:25:59.719678 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13763647-1001-4d41-8a8a-ee112cd59f93 None admin] PATH_INFO: `/v3/users/ca179b0a3ab4467ba61f4e713c6eb763` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:25:59.720941 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13763647-1001-4d41-8a8a-ee112cd59f93 None admin] RBAC: Authorizing `identity:get_user(user_id=ca179b0a3ab4467ba61f4e713c6eb763)` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:25:59.721625 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e723f5fc-7c35-4095-b18e-2ac4dd8570cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:25:59.722305 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e723f5fc-7c35-4095-b18e-2ac4dd8570cb None admin] REQUEST_METHOD: `POST` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:25:59.722475 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13763647-1001-4d41-8a8a-ee112cd59f93 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:25:59.722632 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e723f5fc-7c35-4095-b18e-2ac4dd8570cb None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:25:59.722878 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e723f5fc-7c35-4095-b18e-2ac4dd8570cb None admin] PATH_INFO: `/v3/roles` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:25:59.723647 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e723f5fc-7c35-4095-b18e-2ac4dd8570cb None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:25:59.724284 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 21/36] 10.222.0.62 () {56 vars in 1177 bytes} [Fri May 27 08:25:59 2022] GET /identity/v3/users/ca179b0a3ab4467ba61f4e713c6eb763 => generated 247 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:25:59.725745 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e723f5fc-7c35-4095-b18e-2ac4dd8570cb None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:25:59.726546 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9549ef5d-794c-4dd5-886d-f9d5e7f653f6 None None] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:25:59.726838 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9549ef5d-794c-4dd5-886d-f9d5e7f653f6 None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:25:59.727119 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9549ef5d-794c-4dd5-886d-f9d5e7f653f6 None None] PATH_INFO: `/` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:25:59.728478 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 22/37] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:25:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:25:59.731412 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9549ef5d-794c-4dd5-886d-f9d5e7f653f6 None None] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:25:59.745030 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 16/38] 10.222.0.62 () {60 vars in 1131 bytes} [Fri May 27 08:25:59 2022] POST /identity/v3/roles => generated 225 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 08:25:59.746409 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aa3f87-607b-4aa1-bf06-6164c502fe59 None None] REQUEST_METHOD: `POST` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:25:59.746712 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aa3f87-607b-4aa1-bf06-6164c502fe59 None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:25:59.746998 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aa3f87-607b-4aa1-bf06-6164c502fe59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:25:59.753445 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:25:59.773144 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.auth.core [None req-d0aa3f87-607b-4aa1-bf06-6164c502fe59 None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:25:59.774737 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.fernet_utils [None req-d0aa3f87-607b-4aa1-bf06-6164c502fe59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:25:59.805586 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:25:59.874431 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 17/39] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:25:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 08:25:59.876331 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9549ef5d-794c-4dd5-886d-f9d5e7f653f6 None None] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:25:59.901200 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aa3f87-607b-4aa1-bf06-6164c502fe59 None None] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:25:59.921075 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aab6642-1d38-43a2-982e-c67c1ee6d9bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:25:59.921987 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aab6642-1d38-43a2-982e-c67c1ee6d9bb None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:25:59.922279 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aab6642-1d38-43a2-982e-c67c1ee6d9bb None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:25:59.922558 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aab6642-1d38-43a2-982e-c67c1ee6d9bb None admin] PATH_INFO: `/v3/domains/default` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:25:59.923809 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aab6642-1d38-43a2-982e-c67c1ee6d9bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:25:59.925541 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aab6642-1d38-43a2-982e-c67c1ee6d9bb None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:25:59.928563 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 23/40] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 08:25:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:25:59.934544 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aab6642-1d38-43a2-982e-c67c1ee6d9bb None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:00.028357 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aa3f87-607b-4aa1-bf06-6164c502fe59 None None] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:00.063714 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:00.069289 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aec4dd-1810-446d-ab0d-674667b6835a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:00.069976 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aec4dd-1810-446d-ab0d-674667b6835a None admin] REQUEST_METHOD: `POST` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:00.070270 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aec4dd-1810-446d-ab0d-674667b6835a None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:00.070542 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aec4dd-1810-446d-ab0d-674667b6835a None admin] PATH_INFO: `/v3/roles` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:00.071293 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28aec4dd-1810-446d-ab0d-674667b6835a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:00.072748 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28aec4dd-1810-446d-ab0d-674667b6835a None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:00.080774 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aab6642-1d38-43a2-982e-c67c1ee6d9bb None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:00.091909 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 18/41] 10.222.0.62 () {60 vars in 1131 bytes} [Fri May 27 08:25:59 2022] POST /identity/v3/roles => generated 223 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 08:26:00.114775 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:00.133756 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9412479b-5d7d-482a-9ba0-866bd53af415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:00.134688 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9412479b-5d7d-482a-9ba0-866bd53af415 None admin] REQUEST_METHOD: `PUT` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:00.134978 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9412479b-5d7d-482a-9ba0-866bd53af415 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:00.135262 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9412479b-5d7d-482a-9ba0-866bd53af415 None admin] PATH_INFO: `/v3/domains/default/users/ca179b0a3ab4467ba61f4e713c6eb763/roles/5e6f243a7201412c965e7c70249d4dc0` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:00.137492 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9412479b-5d7d-482a-9ba0-866bd53af415 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=ca179b0a3ab4467ba61f4e713c6eb763, role_id=5e6f243a7201412c965e7c70249d4dc0)` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:00.139005 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9412479b-5d7d-482a-9ba0-866bd53af415 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:00.176215 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4a0bcf-eb99-4c95-9832-b32abca0f3fb None None] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:00.176698 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4a0bcf-eb99-4c95-9832-b32abca0f3fb None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:00.177086 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4a0bcf-eb99-4c95-9832-b32abca0f3fb None None] PATH_INFO: `/` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:00.178961 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 19/42] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:26:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 08:26:00.184852 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9f40b0-1e73-4a94-aa66-d66e89f6e7b4 None None] REQUEST_METHOD: `POST` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:00.185216 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9f40b0-1e73-4a94-aa66-d66e89f6e7b4 None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:00.185563 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9f40b0-1e73-4a94-aa66-d66e89f6e7b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:00.204235 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.auth.core [None req-fd9f40b0-1e73-4a94-aa66-d66e89f6e7b4 None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:26:00.205464 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.fernet_utils [None req-fd9f40b0-1e73-4a94-aa66-d66e89f6e7b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:26:00.265750 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 24/43] 10.222.0.62 () {58 vars in 1361 bytes} [Fri May 27 08:25:59 2022] PUT /identity/v3/domains/default/users/ca179b0a3ab4467ba61f4e713c6eb763/roles/5e6f243a7201412c965e7c70249d4dc0 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 08:26:00.293340 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 20/44] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:26:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 08:26:00.320496 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9412479b-5d7d-482a-9ba0-866bd53af415 None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:00.440385 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9412479b-5d7d-482a-9ba0-866bd53af415 None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:00.486937 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667e013a-fed3-4f03-be43-cc4b3f119f52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:00.487941 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667e013a-fed3-4f03-be43-cc4b3f119f52 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:00.488360 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667e013a-fed3-4f03-be43-cc4b3f119f52 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:00.488811 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667e013a-fed3-4f03-be43-cc4b3f119f52 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:00.490781 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667e013a-fed3-4f03-be43-cc4b3f119f52 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:00.492475 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667e013a-fed3-4f03-be43-cc4b3f119f52 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:00.497073 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 25/45] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 08:26:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:26:00.502769 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9f40b0-1e73-4a94-aa66-d66e89f6e7b4 None None] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:00.612640 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9f40b0-1e73-4a94-aa66-d66e89f6e7b4 None None] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:00.639003 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:00.656247 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6425925-5cf7-4e33-b5c0-0ce8f8c41072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:00.656968 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6425925-5cf7-4e33-b5c0-0ce8f8c41072 None admin] REQUEST_METHOD: `POST` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:00.657256 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6425925-5cf7-4e33-b5c0-0ce8f8c41072 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:00.657539 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6425925-5cf7-4e33-b5c0-0ce8f8c41072 None admin] PATH_INFO: `/v3/projects` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:00.658280 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6425925-5cf7-4e33-b5c0-0ce8f8c41072 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:00.659772 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6425925-5cf7-4e33-b5c0-0ce8f8c41072 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:00.688373 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 21/46] 10.222.0.62 () {60 vars in 1141 bytes} [Fri May 27 08:26:00 2022] POST /identity/v3/projects => generated 312 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 08:26:02.573610 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff94eb0-a86f-4a52-8e36-d166a103549a None None] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:02.574153 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff94eb0-a86f-4a52-8e36-d166a103549a None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:02.574254 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff94eb0-a86f-4a52-8e36-d166a103549a None None] PATH_INFO: `/` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:02.575570 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 26/47] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:26:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:26:02.580949 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103b881b-a7e8-49ae-b27a-ba3c6814303b None None] REQUEST_METHOD: `POST` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:02.581331 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103b881b-a7e8-49ae-b27a-ba3c6814303b None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:02.581622 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103b881b-a7e8-49ae-b27a-ba3c6814303b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:02.599030 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.auth.core [None req-103b881b-a7e8-49ae-b27a-ba3c6814303b None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:26:02.600314 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.fernet_utils [None req-103b881b-a7e8-49ae-b27a-ba3c6814303b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:26:02.668850 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 22/48] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:26:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 08:26:02.693546 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff94eb0-a86f-4a52-8e36-d166a103549a None None] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:02.745965 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:02.806728 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff94eb0-a86f-4a52-8e36-d166a103549a None None] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:02.845195 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891dc480-f87c-49b6-a4fc-76070efe5c00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:02.845935 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891dc480-f87c-49b6-a4fc-76070efe5c00 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:02.846225 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891dc480-f87c-49b6-a4fc-76070efe5c00 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:02.846508 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891dc480-f87c-49b6-a4fc-76070efe5c00 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:02.858681 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891dc480-f87c-49b6-a4fc-76070efe5c00 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 08:26:02.867143 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application [None req-891dc480-f87c-49b6-a4fc-76070efe5c00 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 08:26:02.867143 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:26:02.867143 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:26:02.867143 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:26:02.867143 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:26:02.867143 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:26:02.867143 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:26:02.867143 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:26:02.867143 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:26:02.867143 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:26:02.867143 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:26:02.867143 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:26:02.867143 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 08:26:02.867143 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 08:26:02.867143 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 08:26:02.867143 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 08:26:02.868041 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 08:26:02.868041 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 08:26:02.868041 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 08:26:02.868041 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 08:26:02.868041 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:26:02.868041 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:26:02.868041 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:26:02.868041 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:26:02.868041 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:26:02.868041 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:26:02.868041 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:26:02.868041 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application with Lock( May 27 08:26:02.868041 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:26:02.868041 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._enter() May 27 08:26:02.868041 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:26:02.868041 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:26:02.868929 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:26:02.868929 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.creator() May 27 08:26:02.868929 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:26:02.868929 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application created_value = creator( May 27 08:26:02.868929 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 08:26:02.868929 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 08:26:02.868929 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 08:26:02.868929 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 08:26:02.868929 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 08:26:02.868929 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 08:26:02.868929 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 08:26:02.868929 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application May 27 08:26:02.868929 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 27/49] 10.222.0.62 () {56 vars in 1096 bytes} [Fri May 27 08:26:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 08:26:02.874308 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103b881b-a7e8-49ae-b27a-ba3c6814303b None None] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:02.976963 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103b881b-a7e8-49ae-b27a-ba3c6814303b None None] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:02.979242 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:03.013764 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6cea99-54c0-455c-90a4-2a972a7574a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:03.014448 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6cea99-54c0-455c-90a4-2a972a7574a0 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:03.014736 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6cea99-54c0-455c-90a4-2a972a7574a0 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:03.015017 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6cea99-54c0-455c-90a4-2a972a7574a0 None admin] PATH_INFO: `/v3/roles` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:03.015770 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6cea99-54c0-455c-90a4-2a972a7574a0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:26:03.016079 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6cea99-54c0-455c-90a4-2a972a7574a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:03.017519 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6cea99-54c0-455c-90a4-2a972a7574a0 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:03.025780 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 23/50] 10.222.0.62 () {56 vars in 1099 bytes} [Fri May 27 08:26:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:26:03.031319 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891dc480-f87c-49b6-a4fc-76070efe5c00 None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:03.043235 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4052168-22cb-451e-8b30-f69c97101133 None None] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:03.043528 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4052168-22cb-451e-8b30-f69c97101133 None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:03.043808 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4052168-22cb-451e-8b30-f69c97101133 None None] PATH_INFO: `/` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:03.045199 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 24/51] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:26:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 08:26:03.050108 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02965aa7-4c32-4735-b770-6a011e8240c8 None None] REQUEST_METHOD: `POST` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:03.050401 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02965aa7-4c32-4735-b770-6a011e8240c8 None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:03.050686 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02965aa7-4c32-4735-b770-6a011e8240c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:03.068991 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.auth.core [None req-02965aa7-4c32-4735-b770-6a011e8240c8 None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:26:03.070222 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.fernet_utils [None req-02965aa7-4c32-4735-b770-6a011e8240c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:26:03.134998 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891dc480-f87c-49b6-a4fc-76070efe5c00 None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:03.138845 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 25/52] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:26:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 08:26:03.144002 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:03.165668 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02965aa7-4c32-4735-b770-6a011e8240c8 None None] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:03.170605 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cefa5b2-afd6-4013-9870-93405eb2f5d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:03.171528 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cefa5b2-afd6-4013-9870-93405eb2f5d5 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:03.171819 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cefa5b2-afd6-4013-9870-93405eb2f5d5 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:03.172099 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cefa5b2-afd6-4013-9870-93405eb2f5d5 None admin] PATH_INFO: `/v3/users/ca179b0a3ab4467ba61f4e713c6eb763` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:03.173533 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cefa5b2-afd6-4013-9870-93405eb2f5d5 None admin] RBAC: Authorizing `identity:get_user(user_id=ca179b0a3ab4467ba61f4e713c6eb763)` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:03.175038 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cefa5b2-afd6-4013-9870-93405eb2f5d5 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:03.176885 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 28/53] 10.222.0.62 () {56 vars in 1177 bytes} [Fri May 27 08:26:03 2022] GET /identity/v3/users/ca179b0a3ab4467ba61f4e713c6eb763 => generated 247 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 08:26:03.183506 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cefa5b2-afd6-4013-9870-93405eb2f5d5 None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:03.266476 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:03.273201 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02965aa7-4c32-4735-b770-6a011e8240c8 None None] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:03.290752 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cefa5b2-afd6-4013-9870-93405eb2f5d5 None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:03.309045 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57931cac-9393-4c4c-92c6-a518c374d588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:03.309844 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57931cac-9393-4c4c-92c6-a518c374d588 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:03.310147 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57931cac-9393-4c4c-92c6-a518c374d588 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:03.310417 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57931cac-9393-4c4c-92c6-a518c374d588 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:03.311607 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57931cac-9393-4c4c-92c6-a518c374d588 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:03.313113 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57931cac-9393-4c4c-92c6-a518c374d588 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:03.314749 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 26/54] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 08:26:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 08:26:03.320475 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57931cac-9393-4c4c-92c6-a518c374d588 None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:03.325212 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a846d4d-cb47-4e09-bdd2-bf83c3fdd489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:03.326006 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a846d4d-cb47-4e09-bdd2-bf83c3fdd489 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:03.326296 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a846d4d-cb47-4e09-bdd2-bf83c3fdd489 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:03.326580 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a846d4d-cb47-4e09-bdd2-bf83c3fdd489 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:03.327767 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a846d4d-cb47-4e09-bdd2-bf83c3fdd489 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:03.329279 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a846d4d-cb47-4e09-bdd2-bf83c3fdd489 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:03.331065 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 29/55] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 08:26:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 08:26:03.336795 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a846d4d-cb47-4e09-bdd2-bf83c3fdd489 None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:03.382754 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:03.421164 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57931cac-9393-4c4c-92c6-a518c374d588 None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:03.438170 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a846d4d-cb47-4e09-bdd2-bf83c3fdd489 None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:03.456696 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6478998b-2190-4cbb-ad1d-ebb2f05459c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:03.457365 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6478998b-2190-4cbb-ad1d-ebb2f05459c8 None admin] REQUEST_METHOD: `POST` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:03.457656 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6478998b-2190-4cbb-ad1d-ebb2f05459c8 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:03.457947 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6478998b-2190-4cbb-ad1d-ebb2f05459c8 None admin] PATH_INFO: `/v3/projects` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:03.458678 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6478998b-2190-4cbb-ad1d-ebb2f05459c8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:03.460458 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6478998b-2190-4cbb-ad1d-ebb2f05459c8 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:03.472489 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab4fb1f-cf1d-4c9c-9991-57a058932e01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:03.473184 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab4fb1f-cf1d-4c9c-9991-57a058932e01 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:03.473468 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab4fb1f-cf1d-4c9c-9991-57a058932e01 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:03.473745 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab4fb1f-cf1d-4c9c-9991-57a058932e01 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:03.475126 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab4fb1f-cf1d-4c9c-9991-57a058932e01 None admin] RBAC: Adding query filter params (role.id=5e6f243a7201412c965e7c70249d4dc0, scope.domain.id=default, user.id=ca179b0a3ab4467ba61f4e713c6eb763) {{(pid=87173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:26:03.475589 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab4fb1f-cf1d-4c9c-9991-57a058932e01 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:03.476953 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab4fb1f-cf1d-4c9c-9991-57a058932e01 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:03.484460 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 30/56] 10.222.0.62 () {56 vars in 1322 bytes} [Fri May 27 08:26:03 2022] GET /identity/v3/role_assignments?user.id=ca179b0a3ab4467ba61f4e713c6eb763&scope.domain.id=default&role.id=5e6f243a7201412c965e7c70249d4dc0 => generated 530 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:26:03.493246 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 27/57] 10.222.0.62 () {60 vars in 1140 bytes} [Fri May 27 08:26:03 2022] POST /identity/v3/projects => generated 298 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 08:26:05.823194 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727a3d90-26ba-4868-aaa2-a1c7d04be252 None None] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:05.823706 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727a3d90-26ba-4868-aaa2-a1c7d04be252 None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:05.823792 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727a3d90-26ba-4868-aaa2-a1c7d04be252 None None] PATH_INFO: `/` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:05.825143 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 31/58] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:26:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:26:05.830219 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8395d2-93d5-406e-b9ba-fe54a78c3bf4 None None] REQUEST_METHOD: `POST` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:05.830650 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8395d2-93d5-406e-b9ba-fe54a78c3bf4 None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:05.830798 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8395d2-93d5-406e-b9ba-fe54a78c3bf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:05.848319 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.auth.core [None req-1c8395d2-93d5-406e-b9ba-fe54a78c3bf4 None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:26:05.850246 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.fernet_utils [None req-1c8395d2-93d5-406e-b9ba-fe54a78c3bf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:26:05.861614 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:05.920100 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 28/59] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:26:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 08:26:05.947265 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727a3d90-26ba-4868-aaa2-a1c7d04be252 None None] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:06.047882 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727a3d90-26ba-4868-aaa2-a1c7d04be252 None None] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:06.057701 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:06.082348 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728a3ccf-74b1-44c9-bd07-ad23881727db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:06.083140 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728a3ccf-74b1-44c9-bd07-ad23881727db None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:06.083424 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728a3ccf-74b1-44c9-bd07-ad23881727db None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:06.084239 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728a3ccf-74b1-44c9-bd07-ad23881727db None admin] PATH_INFO: `/v3/domains/default` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:06.085752 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728a3ccf-74b1-44c9-bd07-ad23881727db None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:06.087227 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728a3ccf-74b1-44c9-bd07-ad23881727db None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:06.088881 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 32/60] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 08:26:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:26:06.094380 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8395d2-93d5-406e-b9ba-fe54a78c3bf4 None None] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:06.192511 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8395d2-93d5-406e-b9ba-fe54a78c3bf4 None None] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:06.226491 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c2b907-99fb-4ee0-b011-7802da6177d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:06.227228 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c2b907-99fb-4ee0-b011-7802da6177d2 None admin] REQUEST_METHOD: `POST` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:06.227535 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c2b907-99fb-4ee0-b011-7802da6177d2 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:06.227850 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c2b907-99fb-4ee0-b011-7802da6177d2 None admin] PATH_INFO: `/v3/users` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:06.228770 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c2b907-99fb-4ee0-b011-7802da6177d2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:06.230691 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c2b907-99fb-4ee0-b011-7802da6177d2 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:06.257942 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 29/61] 10.222.0.62 () {60 vars in 1132 bytes} [Fri May 27 08:26:06 2022] POST /identity/v3/users => generated 275 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 08:26:09.819573 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bae701-16ff-4f6d-9482-5d9dd7a0b163 None None] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:09.820614 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bae701-16ff-4f6d-9482-5d9dd7a0b163 None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:09.821157 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bae701-16ff-4f6d-9482-5d9dd7a0b163 None None] PATH_INFO: `/` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:09.823047 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 33/62] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:26:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:26:09.828783 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27db7175-1027-47db-a2d0-86704fd345ce None None] REQUEST_METHOD: `POST` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:09.829645 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27db7175-1027-47db-a2d0-86704fd345ce None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:09.830129 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27db7175-1027-47db-a2d0-86704fd345ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:09.842479 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:09.862309 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.auth.core [None req-27db7175-1027-47db-a2d0-86704fd345ce None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:26:09.863546 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.fernet_utils [None req-27db7175-1027-47db-a2d0-86704fd345ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:26:09.955503 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e744005-0c4e-46c6-a1c3-50dd66b5bb48 None None] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:09.955795 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e744005-0c4e-46c6-a1c3-50dd66b5bb48 None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:09.955994 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e744005-0c4e-46c6-a1c3-50dd66b5bb48 None None] PATH_INFO: `/` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:09.957420 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 34/63] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:26:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 08:26:09.963373 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 30/64] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:26:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 08:26:09.964214 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca82d3bb-a882-47a7-8607-f0a13d491dd5 None None] REQUEST_METHOD: `POST` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:09.964779 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca82d3bb-a882-47a7-8607-f0a13d491dd5 None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:09.964902 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab15a66c-1e55-4cb3-9d5a-7701783f30ad None None] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:09.965123 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab15a66c-1e55-4cb3-9d5a-7701783f30ad None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:09.965414 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab15a66c-1e55-4cb3-9d5a-7701783f30ad None None] PATH_INFO: `/` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:09.965795 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca82d3bb-a882-47a7-8607-f0a13d491dd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:09.966853 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 31/65] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:26:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:26:09.973264 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db702a1f-382c-4c03-bc52-7fcd8ad9731e None None] REQUEST_METHOD: `POST` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:09.973591 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db702a1f-382c-4c03-bc52-7fcd8ad9731e None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:09.973846 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db702a1f-382c-4c03-bc52-7fcd8ad9731e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:09.998004 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.auth.core [None req-ca82d3bb-a882-47a7-8607-f0a13d491dd5 None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:26:09.999186 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.auth.core [None req-db702a1f-382c-4c03-bc52-7fcd8ad9731e None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:26:10.000176 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.fernet_utils [None req-ca82d3bb-a882-47a7-8607-f0a13d491dd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:26:10.000370 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.fernet_utils [None req-db702a1f-382c-4c03-bc52-7fcd8ad9731e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:26:10.086556 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 35/66] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:26:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 08:26:10.087639 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca82d3bb-a882-47a7-8607-f0a13d491dd5 None None] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:10.100193 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 32/67] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:26:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 08:26:10.112633 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db702a1f-382c-4c03-bc52-7fcd8ad9731e None None] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:10.188905 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:10.228278 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca82d3bb-a882-47a7-8607-f0a13d491dd5 None None] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:10.238353 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:10.245845 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db702a1f-382c-4c03-bc52-7fcd8ad9731e None None] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:10.279139 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c628c0e-7561-46ea-88ed-89359f9c0d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:10.279969 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c628c0e-7561-46ea-88ed-89359f9c0d90 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:10.280255 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c628c0e-7561-46ea-88ed-89359f9c0d90 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:10.280534 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c628c0e-7561-46ea-88ed-89359f9c0d90 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:10.297019 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c628c0e-7561-46ea-88ed-89359f9c0d90 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 08:26:10.299337 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d770460c-afe2-4ac5-b7b8-89196b6adf98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:10.300384 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d770460c-afe2-4ac5-b7b8-89196b6adf98 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:10.300873 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d770460c-afe2-4ac5-b7b8-89196b6adf98 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:10.301299 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d770460c-afe2-4ac5-b7b8-89196b6adf98 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:10.307978 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application [None req-0c628c0e-7561-46ea-88ed-89359f9c0d90 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 08:26:10.307978 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:26:10.307978 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:26:10.307978 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:26:10.307978 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:26:10.307978 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:26:10.307978 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:26:10.307978 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:26:10.307978 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:26:10.307978 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:26:10.307978 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:26:10.307978 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:26:10.307978 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 08:26:10.307978 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 08:26:10.307978 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 08:26:10.307978 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 08:26:10.308948 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 08:26:10.308948 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 08:26:10.308948 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 08:26:10.308948 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 08:26:10.308948 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:26:10.308948 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:26:10.308948 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:26:10.308948 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:26:10.308948 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:26:10.308948 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:26:10.308948 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:26:10.308948 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application with Lock( May 27 08:26:10.308948 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:26:10.308948 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._enter() May 27 08:26:10.308948 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:26:10.308948 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:26:10.309721 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:26:10.309721 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.creator() May 27 08:26:10.309721 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:26:10.309721 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application created_value = creator( May 27 08:26:10.309721 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 08:26:10.309721 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 08:26:10.309721 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 08:26:10.309721 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 08:26:10.309721 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 08:26:10.309721 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 08:26:10.309721 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 08:26:10.309721 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application May 27 08:26:10.309721 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 36/68] 10.222.0.62 () {56 vars in 1114 bytes} [Fri May 27 08:26:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 08:26:10.310351 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c628c0e-7561-46ea-88ed-89359f9c0d90 None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:10.324936 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d770460c-afe2-4ac5-b7b8-89196b6adf98 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 08:26:10.338929 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application [None req-d770460c-afe2-4ac5-b7b8-89196b6adf98 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 08:26:10.338929 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:26:10.338929 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:26:10.338929 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:26:10.338929 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:26:10.338929 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:26:10.338929 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:26:10.338929 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:26:10.338929 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:26:10.338929 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:26:10.338929 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:26:10.338929 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:26:10.338929 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 08:26:10.338929 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 08:26:10.338929 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 08:26:10.338929 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 08:26:10.339876 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 08:26:10.339876 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 08:26:10.339876 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 08:26:10.339876 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 08:26:10.339876 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:26:10.339876 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:26:10.339876 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:26:10.339876 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:26:10.339876 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:26:10.339876 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:26:10.339876 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:26:10.339876 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application with Lock( May 27 08:26:10.339876 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:26:10.339876 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._enter() May 27 08:26:10.339876 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:26:10.339876 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:26:10.340664 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:26:10.340664 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.creator() May 27 08:26:10.340664 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:26:10.340664 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application created_value = creator( May 27 08:26:10.340664 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 08:26:10.340664 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 08:26:10.340664 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 08:26:10.340664 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 08:26:10.340664 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 08:26:10.340664 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 08:26:10.340664 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 08:26:10.340664 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application May 27 08:26:10.341254 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 33/69] 10.222.0.62 () {56 vars in 1099 bytes} [Fri May 27 08:26:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 08:26:10.341636 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d770460c-afe2-4ac5-b7b8-89196b6adf98 None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:10.445644 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c628c0e-7561-46ea-88ed-89359f9c0d90 None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:10.466665 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d770460c-afe2-4ac5-b7b8-89196b6adf98 None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:10.480999 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae6c9ec-011a-45a9-8657-1ed66d35ff60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:10.481730 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae6c9ec-011a-45a9-8657-1ed66d35ff60 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:10.482113 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae6c9ec-011a-45a9-8657-1ed66d35ff60 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:10.482298 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae6c9ec-011a-45a9-8657-1ed66d35ff60 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:10.493837 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae6c9ec-011a-45a9-8657-1ed66d35ff60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 08:26:10.494260 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:10.502273 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application [None req-0ae6c9ec-011a-45a9-8657-1ed66d35ff60 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 08:26:10.502273 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:26:10.502273 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:26:10.502273 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:26:10.502273 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:26:10.502273 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:26:10.502273 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:26:10.502273 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:26:10.502273 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:26:10.502273 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:26:10.502273 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:26:10.502273 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:26:10.502273 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 08:26:10.502273 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 08:26:10.502273 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 08:26:10.502273 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 08:26:10.503142 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 08:26:10.503142 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 08:26:10.503142 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 08:26:10.503142 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 08:26:10.503142 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:26:10.503142 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:26:10.503142 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:26:10.503142 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:26:10.503142 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:26:10.503142 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:26:10.503142 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:26:10.503142 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application with Lock( May 27 08:26:10.503142 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:26:10.503142 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._enter() May 27 08:26:10.503142 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:26:10.503142 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:26:10.503898 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:26:10.503898 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.creator() May 27 08:26:10.503898 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:26:10.503898 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application created_value = creator( May 27 08:26:10.503898 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 08:26:10.503898 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 08:26:10.503898 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 08:26:10.503898 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 08:26:10.503898 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 08:26:10.503898 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 08:26:10.503898 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 08:26:10.503898 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application May 27 08:26:10.503898 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 37/70] 10.222.0.62 () {56 vars in 1096 bytes} [Fri May 27 08:26:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 08:26:10.505151 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae6c9ec-011a-45a9-8657-1ed66d35ff60 None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:10.512907 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff36cee7-b902-424f-9fc3-af7844f8ce24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:10.513724 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff36cee7-b902-424f-9fc3-af7844f8ce24 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:10.514024 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff36cee7-b902-424f-9fc3-af7844f8ce24 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:10.514312 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff36cee7-b902-424f-9fc3-af7844f8ce24 None admin] PATH_INFO: `/v3/roles` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:10.515087 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff36cee7-b902-424f-9fc3-af7844f8ce24 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:26:10.515462 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff36cee7-b902-424f-9fc3-af7844f8ce24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:10.516916 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff36cee7-b902-424f-9fc3-af7844f8ce24 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:10.525916 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 34/71] 10.222.0.62 () {56 vars in 1111 bytes} [Fri May 27 08:26:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:26:10.527460 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc3dbac-3e5d-46b7-9d17-695c001bba41 None None] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:10.527756 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc3dbac-3e5d-46b7-9d17-695c001bba41 None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:10.528042 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc3dbac-3e5d-46b7-9d17-695c001bba41 None None] PATH_INFO: `/` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:10.529312 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 35/72] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:26:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:26:10.530140 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc3dbac-3e5d-46b7-9d17-695c001bba41 None None] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:10.543390 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:10.619603 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae6c9ec-011a-45a9-8657-1ed66d35ff60 None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:10.637075 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc3dbac-3e5d-46b7-9d17-695c001bba41 None None] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:10.654469 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da8466c-95cb-4e8e-9e03-4d0931fa2004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:10.655147 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da8466c-95cb-4e8e-9e03-4d0931fa2004 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:10.655436 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da8466c-95cb-4e8e-9e03-4d0931fa2004 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:10.655719 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da8466c-95cb-4e8e-9e03-4d0931fa2004 None admin] PATH_INFO: `/v3/roles` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:10.656475 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da8466c-95cb-4e8e-9e03-4d0931fa2004 None admin] RBAC: Adding query filter params (name=member) {{(pid=87173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:26:10.656833 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da8466c-95cb-4e8e-9e03-4d0931fa2004 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:10.658238 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da8466c-95cb-4e8e-9e03-4d0931fa2004 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:10.667295 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 38/73] 10.222.0.62 () {56 vars in 1101 bytes} [Fri May 27 08:26:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:26:10.668178 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da8466c-95cb-4e8e-9e03-4d0931fa2004 None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:10.674699 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53f50bf-a87b-48b3-96eb-27d274f1ef6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:10.675368 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53f50bf-a87b-48b3-96eb-27d274f1ef6b None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:10.675658 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53f50bf-a87b-48b3-96eb-27d274f1ef6b None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:10.675936 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53f50bf-a87b-48b3-96eb-27d274f1ef6b None admin] PATH_INFO: `/v3/roles` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:10.676732 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53f50bf-a87b-48b3-96eb-27d274f1ef6b None admin] RBAC: Adding query filter params (name=admin) {{(pid=87172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:26:10.677039 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53f50bf-a87b-48b3-96eb-27d274f1ef6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:10.679197 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53f50bf-a87b-48b3-96eb-27d274f1ef6b None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:10.687837 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 36/74] 10.222.0.62 () {56 vars in 1099 bytes} [Fri May 27 08:26:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:26:10.689077 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a261541-0aa7-4ca9-9cc9-f78b90ccdf22 None None] REQUEST_METHOD: `POST` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:10.689367 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a261541-0aa7-4ca9-9cc9-f78b90ccdf22 None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:10.689647 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a261541-0aa7-4ca9-9cc9-f78b90ccdf22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:10.705922 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.auth.core [None req-8a261541-0aa7-4ca9-9cc9-f78b90ccdf22 None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:26:10.707148 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.fernet_utils [None req-8a261541-0aa7-4ca9-9cc9-f78b90ccdf22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:26:10.750153 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:10.758206 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:10.770689 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da8466c-95cb-4e8e-9e03-4d0931fa2004 None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:10.779571 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 37/75] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:26:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 08:26:10.782807 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3e4ed9-e3d3-4acf-b51e-83108e942885 None None] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:10.783116 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3e4ed9-e3d3-4acf-b51e-83108e942885 None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:10.783691 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3e4ed9-e3d3-4acf-b51e-83108e942885 None None] PATH_INFO: `/` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:10.785371 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 38/76] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:26:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:26:10.789389 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3e4ed9-e3d3-4acf-b51e-83108e942885 None None] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:10.813257 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a364cb54-118e-474b-a999-1d54416910b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:10.814132 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a364cb54-118e-474b-a999-1d54416910b2 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:10.814419 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a364cb54-118e-474b-a999-1d54416910b2 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:10.814698 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a364cb54-118e-474b-a999-1d54416910b2 None admin] PATH_INFO: `/v3/users/f12e0800a0284df5b6aec65ab2d4e334` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:10.829670 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a364cb54-118e-474b-a999-1d54416910b2 None admin] RBAC: Authorizing `identity:get_user(user_id=f12e0800a0284df5b6aec65ab2d4e334)` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:10.831155 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a364cb54-118e-474b-a999-1d54416910b2 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:10.832920 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 39/77] 10.222.0.62 () {56 vars in 1177 bytes} [Fri May 27 08:26:10 2022] GET /identity/v3/users/f12e0800a0284df5b6aec65ab2d4e334 => generated 275 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:26:10.834709 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a364cb54-118e-474b-a999-1d54416910b2 None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:10.895433 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3e4ed9-e3d3-4acf-b51e-83108e942885 None None] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:10.931723 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc18d74b-eb44-42da-902a-e6a4a3dd6930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:10.932656 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc18d74b-eb44-42da-902a-e6a4a3dd6930 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:10.932945 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc18d74b-eb44-42da-902a-e6a4a3dd6930 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:10.933227 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc18d74b-eb44-42da-902a-e6a4a3dd6930 None admin] PATH_INFO: `/v3/users/f12e0800a0284df5b6aec65ab2d4e334` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:10.934681 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc18d74b-eb44-42da-902a-e6a4a3dd6930 None admin] RBAC: Authorizing `identity:get_user(user_id=f12e0800a0284df5b6aec65ab2d4e334)` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:10.936174 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc18d74b-eb44-42da-902a-e6a4a3dd6930 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:10.937863 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 39/78] 10.222.0.62 () {56 vars in 1177 bytes} [Fri May 27 08:26:10 2022] GET /identity/v3/users/f12e0800a0284df5b6aec65ab2d4e334 => generated 275 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:26:10.939027 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dd82b9-8992-4f17-ae24-0c1491446e21 None None] REQUEST_METHOD: `POST` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:10.939125 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a364cb54-118e-474b-a999-1d54416910b2 None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:10.939338 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dd82b9-8992-4f17-ae24-0c1491446e21 None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:10.939619 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dd82b9-8992-4f17-ae24-0c1491446e21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:10.956806 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.auth.core [None req-36dd82b9-8992-4f17-ae24-0c1491446e21 None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:26:10.958023 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.fernet_utils [None req-36dd82b9-8992-4f17-ae24-0c1491446e21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:26:10.979285 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfb54fd-2a50-4983-8c39-24a9e73f9f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:10.980307 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfb54fd-2a50-4983-8c39-24a9e73f9f41 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:10.980683 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfb54fd-2a50-4983-8c39-24a9e73f9f41 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:10.981071 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfb54fd-2a50-4983-8c39-24a9e73f9f41 None admin] PATH_INFO: `/v3/users/ca179b0a3ab4467ba61f4e713c6eb763` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:10.982494 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfb54fd-2a50-4983-8c39-24a9e73f9f41 None admin] RBAC: Authorizing `identity:get_user(user_id=ca179b0a3ab4467ba61f4e713c6eb763)` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:10.983969 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfb54fd-2a50-4983-8c39-24a9e73f9f41 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:10.985711 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 40/79] 10.222.0.62 () {56 vars in 1177 bytes} [Fri May 27 08:26:10 2022] GET /identity/v3/users/ca179b0a3ab4467ba61f4e713c6eb763 => generated 247 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:26:10.986613 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfb54fd-2a50-4983-8c39-24a9e73f9f41 None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:11.001338 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:11.003503 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:11.029863 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 40/80] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:26:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 08:26:11.030978 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dd82b9-8992-4f17-ae24-0c1491446e21 None None] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:11.096566 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfb54fd-2a50-4983-8c39-24a9e73f9f41 None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:11.134655 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b98f632-7222-4788-8589-61276683e598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:11.135458 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b98f632-7222-4788-8589-61276683e598 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:11.135745 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b98f632-7222-4788-8589-61276683e598 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:11.136018 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b98f632-7222-4788-8589-61276683e598 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:11.137255 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b98f632-7222-4788-8589-61276683e598 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:11.138743 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b98f632-7222-4788-8589-61276683e598 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:11.140396 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 41/81] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 08:26:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:26:11.145965 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b98f632-7222-4788-8589-61276683e598 None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:11.146136 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dd82b9-8992-4f17-ae24-0c1491446e21 None None] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:11.183907 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0b47f0-7bff-4fc8-8bd4-47c912bea245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:11.184567 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0b47f0-7bff-4fc8-8bd4-47c912bea245 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:11.184897 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0b47f0-7bff-4fc8-8bd4-47c912bea245 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:11.185175 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0b47f0-7bff-4fc8-8bd4-47c912bea245 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:11.229506 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:11.230966 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:11.250751 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b98f632-7222-4788-8589-61276683e598 None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:11.258672 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0b47f0-7bff-4fc8-8bd4-47c912bea245 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:11.260085 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0b47f0-7bff-4fc8-8bd4-47c912bea245 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:11.288204 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ae8c0b-1db6-43b2-be90-623c20e397fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:11.288900 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ae8c0b-1db6-43b2-be90-623c20e397fb None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:11.289199 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ae8c0b-1db6-43b2-be90-623c20e397fb None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:11.289508 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ae8c0b-1db6-43b2-be90-623c20e397fb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:11.358422 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ae8c0b-1db6-43b2-be90-623c20e397fb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:11.359929 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 41/82] 10.222.0.62 () {58 vars in 1282 bytes} [Fri May 27 08:26:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 08:26:11.367396 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ae8c0b-1db6-43b2-be90-623c20e397fb None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:11.367503 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0b47f0-7bff-4fc8-8bd4-47c912bea245 None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:11.438142 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:11.448999 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:11.464560 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0b47f0-7bff-4fc8-8bd4-47c912bea245 None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:11.467955 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 42/83] 10.222.0.62 () {58 vars in 1282 bytes} [Fri May 27 08:26:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 08:26:11.469029 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ae8c0b-1db6-43b2-be90-623c20e397fb None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:11.500188 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132b0020-58dc-4e43-ba5c-b8c8299601d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:11.500880 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132b0020-58dc-4e43-ba5c-b8c8299601d3 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:11.501163 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132b0020-58dc-4e43-ba5c-b8c8299601d3 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:11.501439 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132b0020-58dc-4e43-ba5c-b8c8299601d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:11.570688 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132b0020-58dc-4e43-ba5c-b8c8299601d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:11.572187 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132b0020-58dc-4e43-ba5c-b8c8299601d3 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:11.573998 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ae8c0b-1db6-43b2-be90-623c20e397fb None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:11.607976 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c4bc7c-f1c3-47c5-92c0-30d536fcb94b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:11.608823 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c4bc7c-f1c3-47c5-92c0-30d536fcb94b None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:11.609111 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c4bc7c-f1c3-47c5-92c0-30d536fcb94b None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:11.609389 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c4bc7c-f1c3-47c5-92c0-30d536fcb94b None admin] PATH_INFO: `/v3/roles/member` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:11.620083 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c4bc7c-f1c3-47c5-92c0-30d536fcb94b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 08:26:11.627763 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application [None req-22c4bc7c-f1c3-47c5-92c0-30d536fcb94b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 08:26:11.627763 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:26:11.627763 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:26:11.627763 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:26:11.627763 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:26:11.627763 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:26:11.627763 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:26:11.627763 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:26:11.627763 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:26:11.627763 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:26:11.627763 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:26:11.627763 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:26:11.627763 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 08:26:11.627763 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 08:26:11.627763 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 08:26:11.627763 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 08:26:11.628826 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 08:26:11.628826 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 08:26:11.628826 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 08:26:11.628826 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 08:26:11.628826 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:26:11.628826 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:26:11.628826 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:26:11.628826 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:26:11.628826 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:26:11.628826 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:26:11.628826 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:26:11.628826 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application with Lock( May 27 08:26:11.628826 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:26:11.628826 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._enter() May 27 08:26:11.628826 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:26:11.628826 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:26:11.629774 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:26:11.629774 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.creator() May 27 08:26:11.629774 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:26:11.629774 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application created_value = creator( May 27 08:26:11.629774 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 08:26:11.629774 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 08:26:11.629774 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 08:26:11.629774 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 08:26:11.629774 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 08:26:11.629774 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 08:26:11.629774 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 08:26:11.629774 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application May 27 08:26:11.629774 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 43/84] 10.222.0.62 () {56 vars in 1099 bytes} [Fri May 27 08:26:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 08:26:11.629774 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c4bc7c-f1c3-47c5-92c0-30d536fcb94b None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:11.652791 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:11.679156 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:11.680493 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 42/85] 10.222.0.62 () {58 vars in 1282 bytes} [Fri May 27 08:26:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 08:26:11.681674 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132b0020-58dc-4e43-ba5c-b8c8299601d3 None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:11.744962 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c4bc7c-f1c3-47c5-92c0-30d536fcb94b None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:11.778946 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1135941-d2c2-4189-8c83-68edc3cf3224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:11.779619 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1135941-d2c2-4189-8c83-68edc3cf3224 None admin] REQUEST_METHOD: `POST` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:11.779909 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1135941-d2c2-4189-8c83-68edc3cf3224 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:11.780190 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1135941-d2c2-4189-8c83-68edc3cf3224 None admin] PATH_INFO: `/v3/users` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:11.780955 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1135941-d2c2-4189-8c83-68edc3cf3224 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:11.782465 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1135941-d2c2-4189-8c83-68edc3cf3224 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:11.783464 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132b0020-58dc-4e43-ba5c-b8c8299601d3 None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:11.812625 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 44/86] 10.222.0.62 () {60 vars in 1132 bytes} [Fri May 27 08:26:11 2022] POST /identity/v3/users => generated 289 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 08:26:11.813469 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1135941-d2c2-4189-8c83-68edc3cf3224 None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:11.825275 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21369bbd-63a1-4721-8767-db37844927b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:11.826077 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21369bbd-63a1-4721-8767-db37844927b7 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:11.826369 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21369bbd-63a1-4721-8767-db37844927b7 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:11.826651 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21369bbd-63a1-4721-8767-db37844927b7 None admin] PATH_INFO: `/v3/projects/befb09928b604b3e89c10a3f78d3aede` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:11.827952 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21369bbd-63a1-4721-8767-db37844927b7 None admin] RBAC: Authorizing `identity:get_project(project_id=befb09928b604b3e89c10a3f78d3aede)` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:11.829529 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21369bbd-63a1-4721-8767-db37844927b7 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:11.831388 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 43/87] 10.222.0.62 () {56 vars in 1186 bytes} [Fri May 27 08:26:11 2022] GET /identity/v3/projects/befb09928b604b3e89c10a3f78d3aede => generated 298 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:26:11.832253 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21369bbd-63a1-4721-8767-db37844927b7 None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:11.891883 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:11.947733 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:11.953309 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1135941-d2c2-4189-8c83-68edc3cf3224 None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:11.962480 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21369bbd-63a1-4721-8767-db37844927b7 None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:12.002609 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff0980a-18c7-4df9-8792-e499902a4430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:12.003488 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff0980a-18c7-4df9-8792-e499902a4430 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:12.003778 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff0980a-18c7-4df9-8792-e499902a4430 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:12.004059 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff0980a-18c7-4df9-8792-e499902a4430 None admin] PATH_INFO: `/v3/projects/befb09928b604b3e89c10a3f78d3aede` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:12.005408 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff0980a-18c7-4df9-8792-e499902a4430 None admin] RBAC: Authorizing `identity:get_project(project_id=befb09928b604b3e89c10a3f78d3aede)` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:12.006022 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ebe823-622a-4c9c-87c9-11950548cb90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:12.006873 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff0980a-18c7-4df9-8792-e499902a4430 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:12.006987 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ebe823-622a-4c9c-87c9-11950548cb90 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:12.007179 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ebe823-622a-4c9c-87c9-11950548cb90 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:12.007455 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ebe823-622a-4c9c-87c9-11950548cb90 None admin] PATH_INFO: `/v3/roles` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:12.008226 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ebe823-622a-4c9c-87c9-11950548cb90 None admin] RBAC: Adding query filter params (name=member) {{(pid=87172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:26:12.008798 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ebe823-622a-4c9c-87c9-11950548cb90 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:12.008897 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 45/88] 10.222.0.62 () {56 vars in 1186 bytes} [Fri May 27 08:26:11 2022] GET /identity/v3/projects/befb09928b604b3e89c10a3f78d3aede => generated 298 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:26:12.009413 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff0980a-18c7-4df9-8792-e499902a4430 None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:12.009950 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ebe823-622a-4c9c-87c9-11950548cb90 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:12.023045 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 44/89] 10.222.0.62 () {56 vars in 1101 bytes} [Fri May 27 08:26:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:26:12.024990 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ebe823-622a-4c9c-87c9-11950548cb90 None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:12.134052 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff0980a-18c7-4df9-8792-e499902a4430 None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:12.154066 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ebe823-622a-4c9c-87c9-11950548cb90 None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:12.158350 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:12.186985 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d84e1a-f3e3-4f43-9f21-5204c1112162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:12.188008 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d84e1a-f3e3-4f43-9f21-5204c1112162 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:12.188367 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d84e1a-f3e3-4f43-9f21-5204c1112162 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:12.189731 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d84e1a-f3e3-4f43-9f21-5204c1112162 None admin] PATH_INFO: `/v3/projects/befb09928b604b3e89c10a3f78d3aede` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:12.190040 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d84e1a-f3e3-4f43-9f21-5204c1112162 None admin] RBAC: Authorizing `identity:get_project(project_id=befb09928b604b3e89c10a3f78d3aede)` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:12.191598 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d84e1a-f3e3-4f43-9f21-5204c1112162 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:12.194573 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 46/90] 10.222.0.62 () {56 vars in 1186 bytes} [Fri May 27 08:26:12 2022] GET /identity/v3/projects/befb09928b604b3e89c10a3f78d3aede => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:26:12.195219 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d84e1a-f3e3-4f43-9f21-5204c1112162 None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:12.199363 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca371948-a8a2-4ea9-bd19-0ffbe8a26d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:12.200328 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca371948-a8a2-4ea9-bd19-0ffbe8a26d3f None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:12.200948 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca371948-a8a2-4ea9-bd19-0ffbe8a26d3f None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:12.201432 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca371948-a8a2-4ea9-bd19-0ffbe8a26d3f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:12.202510 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca371948-a8a2-4ea9-bd19-0ffbe8a26d3f None admin] RBAC: Adding query filter params (role.id=9ff71fb5e7b7407d8d243eaa7da0a125, scope.project.id=befb09928b604b3e89c10a3f78d3aede, user.id=f12e0800a0284df5b6aec65ab2d4e334) {{(pid=87172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:26:12.203052 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca371948-a8a2-4ea9-bd19-0ffbe8a26d3f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:12.204773 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca371948-a8a2-4ea9-bd19-0ffbe8a26d3f None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:12.214550 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 45/91] 10.222.0.62 () {56 vars in 1374 bytes} [Fri May 27 08:26:12 2022] GET /identity/v3/role_assignments?user.id=f12e0800a0284df5b6aec65ab2d4e334&scope.project.id=befb09928b604b3e89c10a3f78d3aede&role.id=9ff71fb5e7b7407d8d243eaa7da0a125 => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:26:12.215753 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca371948-a8a2-4ea9-bd19-0ffbe8a26d3f None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:12.252206 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:12.367925 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d84e1a-f3e3-4f43-9f21-5204c1112162 None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:12.408348 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53705688-b00f-4e05-968d-e6afcd2b927b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:12.409421 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53705688-b00f-4e05-968d-e6afcd2b927b None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:12.409913 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53705688-b00f-4e05-968d-e6afcd2b927b None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:12.410413 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53705688-b00f-4e05-968d-e6afcd2b927b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:12.412061 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53705688-b00f-4e05-968d-e6afcd2b927b None admin] RBAC: Adding query filter params (role.id=c980c64bb84b418daa012ae45a054b37, scope.project.id=befb09928b604b3e89c10a3f78d3aede, user.id=f12e0800a0284df5b6aec65ab2d4e334) {{(pid=87173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:26:12.412870 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53705688-b00f-4e05-968d-e6afcd2b927b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:12.414647 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53705688-b00f-4e05-968d-e6afcd2b927b None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:12.421717 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 47/92] 10.222.0.62 () {56 vars in 1374 bytes} [Fri May 27 08:26:12 2022] GET /identity/v3/role_assignments?user.id=f12e0800a0284df5b6aec65ab2d4e334&scope.project.id=befb09928b604b3e89c10a3f78d3aede&role.id=c980c64bb84b418daa012ae45a054b37 => generated 259 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:26:12.422985 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53705688-b00f-4e05-968d-e6afcd2b927b None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:12.426924 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca371948-a8a2-4ea9-bd19-0ffbe8a26d3f None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:12.517595 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b186e4-2ad1-4030-a3e4-55652eb3d529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:12.518939 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b186e4-2ad1-4030-a3e4-55652eb3d529 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:12.523496 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b186e4-2ad1-4030-a3e4-55652eb3d529 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:12.524115 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b186e4-2ad1-4030-a3e4-55652eb3d529 None admin] PATH_INFO: `/v3/users/f12e0800a0284df5b6aec65ab2d4e334` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:12.525855 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b186e4-2ad1-4030-a3e4-55652eb3d529 None admin] RBAC: Authorizing `identity:get_user(user_id=f12e0800a0284df5b6aec65ab2d4e334)` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:12.528313 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b186e4-2ad1-4030-a3e4-55652eb3d529 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:12.534486 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 46/93] 10.222.0.62 () {56 vars in 1177 bytes} [Fri May 27 08:26:12 2022] GET /identity/v3/users/f12e0800a0284df5b6aec65ab2d4e334 => generated 275 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:26:12.542377 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b186e4-2ad1-4030-a3e4-55652eb3d529 None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:12.588074 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:12.592810 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53705688-b00f-4e05-968d-e6afcd2b927b None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:12.621849 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:12.677575 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00b2288-1bd3-4e24-9e9e-a27923b7cf13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:12.678180 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00b2288-1bd3-4e24-9e9e-a27923b7cf13 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:12.678469 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00b2288-1bd3-4e24-9e9e-a27923b7cf13 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:12.678750 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00b2288-1bd3-4e24-9e9e-a27923b7cf13 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:12.679609 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00b2288-1bd3-4e24-9e9e-a27923b7cf13 None admin] RBAC: Adding query filter params (role.id=5e6f243a7201412c965e7c70249d4dc0, scope.project.id=befb09928b604b3e89c10a3f78d3aede, user.id=ca179b0a3ab4467ba61f4e713c6eb763) {{(pid=87173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:26:12.679926 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00b2288-1bd3-4e24-9e9e-a27923b7cf13 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:12.684622 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00b2288-1bd3-4e24-9e9e-a27923b7cf13 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:12.688533 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 48/94] 10.222.0.62 () {56 vars in 1374 bytes} [Fri May 27 08:26:12 2022] GET /identity/v3/role_assignments?user.id=ca179b0a3ab4467ba61f4e713c6eb763&scope.project.id=befb09928b604b3e89c10a3f78d3aede&role.id=5e6f243a7201412c965e7c70249d4dc0 => generated 259 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:26:12.747708 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b186e4-2ad1-4030-a3e4-55652eb3d529 None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:12.791465 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f7bdc8-3467-4a12-91d5-50e6434b0c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:12.792498 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f7bdc8-3467-4a12-91d5-50e6434b0c3e None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:12.793018 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f7bdc8-3467-4a12-91d5-50e6434b0c3e None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:12.793510 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f7bdc8-3467-4a12-91d5-50e6434b0c3e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:12.903196 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f7bdc8-3467-4a12-91d5-50e6434b0c3e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:12.904772 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f7bdc8-3467-4a12-91d5-50e6434b0c3e None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:12.981090 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:13.058470 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 47/95] 10.222.0.62 () {58 vars in 1282 bytes} [Fri May 27 08:26:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 517 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 27 08:26:13.067773 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00b2288-1bd3-4e24-9e9e-a27923b7cf13 None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:13.195529 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00b2288-1bd3-4e24-9e9e-a27923b7cf13 None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:13.233062 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a55e6a-3e2f-4989-afa8-8266810e5095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:13.233881 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a55e6a-3e2f-4989-afa8-8266810e5095 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:13.234250 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a55e6a-3e2f-4989-afa8-8266810e5095 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:13.234532 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a55e6a-3e2f-4989-afa8-8266810e5095 None admin] PATH_INFO: `/v3/projects/4698f614e26e44578837f8500ed63ba9` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:13.235780 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a55e6a-3e2f-4989-afa8-8266810e5095 None admin] RBAC: Authorizing `identity:get_project(project_id=4698f614e26e44578837f8500ed63ba9)` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:13.237302 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a55e6a-3e2f-4989-afa8-8266810e5095 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:13.239027 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 49/96] 10.222.0.62 () {56 vars in 1186 bytes} [Fri May 27 08:26:13 2022] GET /identity/v3/projects/4698f614e26e44578837f8500ed63ba9 => generated 312 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:26:13.245249 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f7bdc8-3467-4a12-91d5-50e6434b0c3e None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:13.376894 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f7bdc8-3467-4a12-91d5-50e6434b0c3e None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:13.426292 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148f38c1-72d9-4abd-9130-2931fc372bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:13.427482 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148f38c1-72d9-4abd-9130-2931fc372bc2 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:13.427773 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148f38c1-72d9-4abd-9130-2931fc372bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:13.428053 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148f38c1-72d9-4abd-9130-2931fc372bc2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:13.429101 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148f38c1-72d9-4abd-9130-2931fc372bc2 None admin] RBAC: Adding query filter params (role.id=c980c64bb84b418daa012ae45a054b37, scope.project.id=4698f614e26e44578837f8500ed63ba9, user.id=f12e0800a0284df5b6aec65ab2d4e334) {{(pid=87172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:26:13.429418 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148f38c1-72d9-4abd-9130-2931fc372bc2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:13.430920 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148f38c1-72d9-4abd-9130-2931fc372bc2 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:13.438264 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 48/97] 10.222.0.62 () {56 vars in 1374 bytes} [Fri May 27 08:26:13 2022] GET /identity/v3/role_assignments?user.id=f12e0800a0284df5b6aec65ab2d4e334&scope.project.id=4698f614e26e44578837f8500ed63ba9&role.id=c980c64bb84b418daa012ae45a054b37 => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:26:13.441037 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:15.223273 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8f9e6f-a596-4890-b5d6-5fbe0d40ddf3 None None] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:15.223888 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8f9e6f-a596-4890-b5d6-5fbe0d40ddf3 None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:15.223888 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8f9e6f-a596-4890-b5d6-5fbe0d40ddf3 None None] PATH_INFO: `/` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:15.225466 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 50/98] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:26:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:26:15.231307 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92571591-46b4-4531-86c2-393295176e37 None None] REQUEST_METHOD: `POST` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:15.231756 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92571591-46b4-4531-86c2-393295176e37 None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:15.231847 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92571591-46b4-4531-86c2-393295176e37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:15.242333 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2b6007-f579-41c8-b08a-fc49fff9a753 None None] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:15.242622 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2b6007-f579-41c8-b08a-fc49fff9a753 None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:15.242908 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2b6007-f579-41c8-b08a-fc49fff9a753 None None] PATH_INFO: `/` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:15.244290 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 51/99] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:26:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 08:26:15.253768 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834a02cc-0c90-4720-833e-eaa18adcdce4 None None] REQUEST_METHOD: `POST` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:15.254064 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834a02cc-0c90-4720-833e-eaa18adcdce4 None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:15.254336 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834a02cc-0c90-4720-833e-eaa18adcdce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:15.265318 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.auth.core [None req-92571591-46b4-4531-86c2-393295176e37 None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:26:15.266572 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.fernet_utils [None req-92571591-46b4-4531-86c2-393295176e37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:26:15.272995 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.auth.core [None req-834a02cc-0c90-4720-833e-eaa18adcdce4 None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:26:15.274188 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.fernet_utils [None req-834a02cc-0c90-4720-833e-eaa18adcdce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:26:15.300471 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:15.350985 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 52/100] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:26:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 08:26:15.394060 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 49/101] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:26:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 08:26:15.417742 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834a02cc-0c90-4720-833e-eaa18adcdce4 None None] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:15.466218 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92571591-46b4-4531-86c2-393295176e37 None None] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:15.649656 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834a02cc-0c90-4720-833e-eaa18adcdce4 None None] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:15.661788 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92571591-46b4-4531-86c2-393295176e37 None None] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:15.711087 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:15.718062 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b69d57-b972-463a-88c7-3a61d31a2ebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:15.718863 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b69d57-b972-463a-88c7-3a61d31a2ebf None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:15.719152 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b69d57-b972-463a-88c7-3a61d31a2ebf None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:15.719431 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b69d57-b972-463a-88c7-3a61d31a2ebf None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:15.720442 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5630fa09-23fe-45b0-9401-7ab1f41fe3a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:15.721540 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5630fa09-23fe-45b0-9401-7ab1f41fe3a8 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:15.721992 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5630fa09-23fe-45b0-9401-7ab1f41fe3a8 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:15.722473 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5630fa09-23fe-45b0-9401-7ab1f41fe3a8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:15.724474 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5630fa09-23fe-45b0-9401-7ab1f41fe3a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:15.726147 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5630fa09-23fe-45b0-9401-7ab1f41fe3a8 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:15.728071 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 53/102] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 08:26:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:26:15.729830 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef93653c-a28a-4212-9f8f-cbb10a844500 None None] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:15.730268 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef93653c-a28a-4212-9f8f-cbb10a844500 None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:15.730790 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef93653c-a28a-4212-9f8f-cbb10a844500 None None] PATH_INFO: `/` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:15.732214 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 54/103] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:26:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:26:15.737529 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03caf55d-66c6-4542-b776-26536701d4dc None None] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:15.738165 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03caf55d-66c6-4542-b776-26536701d4dc None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:15.738615 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03caf55d-66c6-4542-b776-26536701d4dc None None] PATH_INFO: `/` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:15.738817 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b69d57-b972-463a-88c7-3a61d31a2ebf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 08:26:15.740484 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 55/104] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:26:15 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:26:15.741867 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65514ad-dbf2-4dca-87c5-41721a41aac0 None None] REQUEST_METHOD: `POST` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:15.742336 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65514ad-dbf2-4dca-87c5-41721a41aac0 None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:15.742763 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65514ad-dbf2-4dca-87c5-41721a41aac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:15.750704 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application [None req-22b69d57-b972-463a-88c7-3a61d31a2ebf None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 27 08:26:15.750704 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:26:15.750704 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:26:15.750704 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:26:15.750704 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:26:15.750704 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:26:15.750704 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:26:15.750704 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:26:15.750704 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:26:15.750704 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:26:15.750704 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:26:15.750704 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:26:15.750704 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 08:26:15.750704 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 08:26:15.750704 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 08:26:15.750704 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 08:26:15.751844 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 08:26:15.751844 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 08:26:15.751844 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 08:26:15.751844 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 08:26:15.751844 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:26:15.751844 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:26:15.751844 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:26:15.751844 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:26:15.751844 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:26:15.751844 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:26:15.751844 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:26:15.751844 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application with Lock( May 27 08:26:15.751844 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:26:15.751844 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._enter() May 27 08:26:15.751844 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:26:15.751844 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:26:15.752866 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:26:15.752866 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.creator() May 27 08:26:15.752866 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:26:15.752866 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application created_value = creator( May 27 08:26:15.752866 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 08:26:15.752866 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 08:26:15.752866 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 08:26:15.752866 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 08:26:15.752866 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 08:26:15.752866 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 08:26:15.752866 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 27 08:26:15.752866 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application May 27 08:26:15.756743 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 50/105] 10.222.0.62 () {56 vars in 1099 bytes} [Fri May 27 08:26:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 08:26:15.757991 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b69d57-b972-463a-88c7-3a61d31a2ebf None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:15.764256 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.auth.core [None req-d65514ad-dbf2-4dca-87c5-41721a41aac0 None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:26:15.765722 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.fernet_utils [None req-d65514ad-dbf2-4dca-87c5-41721a41aac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:26:15.793730 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:15.843718 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 56/106] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:26:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 08:26:15.850098 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef33b86-8955-4331-9530-612d0da29920 None None] REQUEST_METHOD: `POST` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:15.850704 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef33b86-8955-4331-9530-612d0da29920 None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:15.851162 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef33b86-8955-4331-9530-612d0da29920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:15.876656 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b69d57-b972-463a-88c7-3a61d31a2ebf None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:15.889814 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.auth.core [None req-6ef33b86-8955-4331-9530-612d0da29920 None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:26:15.891047 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.fernet_utils [None req-6ef33b86-8955-4331-9530-612d0da29920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:26:15.909834 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c799e4ad-71c3-43aa-a055-75ed0b7dc732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:15.911441 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c799e4ad-71c3-43aa-a055-75ed0b7dc732 None admin] REQUEST_METHOD: `POST` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:15.911774 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c799e4ad-71c3-43aa-a055-75ed0b7dc732 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:15.912942 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c799e4ad-71c3-43aa-a055-75ed0b7dc732 None admin] PATH_INFO: `/v3/projects` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:15.914029 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c799e4ad-71c3-43aa-a055-75ed0b7dc732 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:15.915686 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c799e4ad-71c3-43aa-a055-75ed0b7dc732 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:15.951062 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 51/107] 10.222.0.62 () {60 vars in 1141 bytes} [Fri May 27 08:26:15 2022] POST /identity/v3/projects => generated 302 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 08:26:15.953467 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c799e4ad-71c3-43aa-a055-75ed0b7dc732 None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:16.010986 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 57/108] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:26:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 08:26:16.012249 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef33b86-8955-4331-9530-612d0da29920 None None] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:16.038023 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:16.120127 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c799e4ad-71c3-43aa-a055-75ed0b7dc732 None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:16.163073 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f239497-94dc-44bb-b816-c9f062833b52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:16.164296 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f239497-94dc-44bb-b816-c9f062833b52 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:16.164842 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f239497-94dc-44bb-b816-c9f062833b52 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:16.165281 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f239497-94dc-44bb-b816-c9f062833b52 None admin] PATH_INFO: `/v3/roles` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:16.166219 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f239497-94dc-44bb-b816-c9f062833b52 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:26:16.166704 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f239497-94dc-44bb-b816-c9f062833b52 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:16.168298 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f239497-94dc-44bb-b816-c9f062833b52 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:16.179709 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 52/109] 10.222.0.62 () {56 vars in 1101 bytes} [Fri May 27 08:26:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:26:16.180960 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f239497-94dc-44bb-b816-c9f062833b52 None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:16.235320 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:16.244659 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef33b86-8955-4331-9530-612d0da29920 None None] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:16.287902 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42d343c-0979-4857-8cb6-e1b999f54ba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:16.288761 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42d343c-0979-4857-8cb6-e1b999f54ba3 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:16.289056 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42d343c-0979-4857-8cb6-e1b999f54ba3 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:16.289340 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42d343c-0979-4857-8cb6-e1b999f54ba3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:16.301708 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42d343c-0979-4857-8cb6-e1b999f54ba3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 08:26:16.310665 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application [None req-c42d343c-0979-4857-8cb6-e1b999f54ba3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 08:26:16.310665 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:26:16.310665 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:26:16.310665 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:26:16.310665 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:26:16.310665 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:26:16.310665 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:26:16.310665 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:26:16.310665 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:26:16.310665 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:26:16.310665 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:26:16.310665 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:26:16.310665 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 08:26:16.310665 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 08:26:16.310665 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 08:26:16.310665 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 08:26:16.311526 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 08:26:16.311526 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 08:26:16.311526 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 08:26:16.311526 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 08:26:16.311526 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:26:16.311526 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:26:16.311526 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:26:16.311526 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:26:16.311526 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:26:16.311526 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:26:16.311526 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:26:16.311526 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application with Lock( May 27 08:26:16.311526 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:26:16.311526 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._enter() May 27 08:26:16.311526 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:26:16.311526 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:26:16.312282 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:26:16.312282 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.creator() May 27 08:26:16.312282 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:26:16.312282 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application created_value = creator( May 27 08:26:16.312282 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 08:26:16.312282 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 08:26:16.312282 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 08:26:16.312282 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 08:26:16.312282 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 08:26:16.312282 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 08:26:16.312282 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 08:26:16.312282 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application May 27 08:26:16.314998 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 58/110] 10.222.0.62 () {56 vars in 1099 bytes} [Fri May 27 08:26:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 08:26:16.315641 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f239497-94dc-44bb-b816-c9f062833b52 None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:16.316555 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42d343c-0979-4857-8cb6-e1b999f54ba3 None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:16.332373 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:16.370509 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad92b53-f052-4169-b04b-37d28088b062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:16.371340 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad92b53-f052-4169-b04b-37d28088b062 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:16.371629 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad92b53-f052-4169-b04b-37d28088b062 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:16.371994 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad92b53-f052-4169-b04b-37d28088b062 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:16.387097 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad92b53-f052-4169-b04b-37d28088b062 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 08:26:16.406972 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application [None req-cad92b53-f052-4169-b04b-37d28088b062 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 08:26:16.406972 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:26:16.406972 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:26:16.406972 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:26:16.406972 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:26:16.406972 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:26:16.406972 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:26:16.406972 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:26:16.406972 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:26:16.406972 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:26:16.406972 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:26:16.406972 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:26:16.406972 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 08:26:16.406972 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 08:26:16.406972 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 08:26:16.406972 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 08:26:16.407891 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 08:26:16.407891 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 08:26:16.407891 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 08:26:16.407891 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 08:26:16.407891 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:26:16.407891 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:26:16.407891 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:26:16.407891 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:26:16.407891 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:26:16.407891 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:26:16.407891 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:26:16.407891 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application with Lock( May 27 08:26:16.407891 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:26:16.407891 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._enter() May 27 08:26:16.407891 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:26:16.407891 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:26:16.408675 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:26:16.408675 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.creator() May 27 08:26:16.408675 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:26:16.408675 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application created_value = creator( May 27 08:26:16.408675 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 08:26:16.408675 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 08:26:16.408675 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 08:26:16.408675 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 08:26:16.408675 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 08:26:16.408675 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 08:26:16.408675 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 08:26:16.408675 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application May 27 08:26:16.414571 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 53/111] 10.222.0.62 () {56 vars in 1114 bytes} [Fri May 27 08:26:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 08:26:16.416102 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad92b53-f052-4169-b04b-37d28088b062 None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:16.482032 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42d343c-0979-4857-8cb6-e1b999f54ba3 None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:16.548668 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a27a89-03a0-4ec2-b500-aac02de36e4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:16.549559 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a27a89-03a0-4ec2-b500-aac02de36e4b None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:16.549840 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a27a89-03a0-4ec2-b500-aac02de36e4b None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:16.550118 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a27a89-03a0-4ec2-b500-aac02de36e4b None admin] PATH_INFO: `/v3/users/93f46d0892534f4a84f618904b9f17fb` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:16.578232 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a27a89-03a0-4ec2-b500-aac02de36e4b None admin] RBAC: Authorizing `identity:get_user(user_id=93f46d0892534f4a84f618904b9f17fb)` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:16.579748 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a27a89-03a0-4ec2-b500-aac02de36e4b None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:16.581828 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 59/112] 10.222.0.62 () {56 vars in 1177 bytes} [Fri May 27 08:26:16 2022] GET /identity/v3/users/93f46d0892534f4a84f618904b9f17fb => generated 289 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:26:16.582598 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a27a89-03a0-4ec2-b500-aac02de36e4b None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:16.597109 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:16.602315 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad92b53-f052-4169-b04b-37d28088b062 None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:16.651045 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf009a3-eb52-4473-8ad9-654332502926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:16.651611 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf009a3-eb52-4473-8ad9-654332502926 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:16.651895 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf009a3-eb52-4473-8ad9-654332502926 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:16.652172 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf009a3-eb52-4473-8ad9-654332502926 None admin] PATH_INFO: `/v3/roles` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:16.652963 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf009a3-eb52-4473-8ad9-654332502926 None admin] RBAC: Adding query filter params (name=member) {{(pid=87172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:26:16.653275 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf009a3-eb52-4473-8ad9-654332502926 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:16.654692 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf009a3-eb52-4473-8ad9-654332502926 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:16.670063 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 54/113] 10.222.0.62 () {56 vars in 1101 bytes} [Fri May 27 08:26:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:26:16.671290 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf009a3-eb52-4473-8ad9-654332502926 None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:16.702301 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:16.747942 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a27a89-03a0-4ec2-b500-aac02de36e4b None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:16.782444 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf009a3-eb52-4473-8ad9-654332502926 None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:16.800357 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d962e3-37db-4682-b1c5-14568f2965af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:16.801973 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d962e3-37db-4682-b1c5-14568f2965af None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:16.802677 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d962e3-37db-4682-b1c5-14568f2965af None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:16.803109 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d962e3-37db-4682-b1c5-14568f2965af None admin] PATH_INFO: `/v3/roles` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:16.804155 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d962e3-37db-4682-b1c5-14568f2965af None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:26:16.804628 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d962e3-37db-4682-b1c5-14568f2965af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:16.806695 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d962e3-37db-4682-b1c5-14568f2965af None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:16.819822 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 60/114] 10.222.0.62 () {56 vars in 1111 bytes} [Fri May 27 08:26:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:26:16.821448 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eef791-eebe-4df6-9e1e-d45c843f61eb None None] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:16.821886 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eef791-eebe-4df6-9e1e-d45c843f61eb None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:16.822287 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eef791-eebe-4df6-9e1e-d45c843f61eb None None] PATH_INFO: `/` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:16.828300 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 61/115] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:26:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:26:16.829731 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76eef791-eebe-4df6-9e1e-d45c843f61eb None None] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:16.835653 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351baa82-2001-45d7-adbd-fcf930dbc701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:16.836638 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351baa82-2001-45d7-adbd-fcf930dbc701 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:16.837028 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351baa82-2001-45d7-adbd-fcf930dbc701 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:16.837406 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351baa82-2001-45d7-adbd-fcf930dbc701 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:16.917689 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351baa82-2001-45d7-adbd-fcf930dbc701 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:16.919585 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351baa82-2001-45d7-adbd-fcf930dbc701 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:16.933082 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:16.954715 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:16.978026 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76eef791-eebe-4df6-9e1e-d45c843f61eb None None] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:17.019634 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b675d6-1376-4530-b714-7c79a0b6d1bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:17.020995 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b675d6-1376-4530-b714-7c79a0b6d1bd None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:17.021365 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b675d6-1376-4530-b714-7c79a0b6d1bd None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:17.021750 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b675d6-1376-4530-b714-7c79a0b6d1bd None admin] PATH_INFO: `/v3/users/f12e0800a0284df5b6aec65ab2d4e334` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:17.023130 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b675d6-1376-4530-b714-7c79a0b6d1bd None admin] RBAC: Authorizing `identity:get_user(user_id=f12e0800a0284df5b6aec65ab2d4e334)` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:17.024737 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b675d6-1376-4530-b714-7c79a0b6d1bd None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:17.026840 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 62/116] 10.222.0.62 () {56 vars in 1177 bytes} [Fri May 27 08:26:16 2022] GET /identity/v3/users/f12e0800a0284df5b6aec65ab2d4e334 => generated 275 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:26:17.027823 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b675d6-1376-4530-b714-7c79a0b6d1bd None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:17.056731 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 55/117] 10.222.0.62 () {58 vars in 1282 bytes} [Fri May 27 08:26:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 08:26:17.058847 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c44dd54-9494-498e-b70c-c3855f16a3d6 None None] REQUEST_METHOD: `POST` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:17.059456 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c44dd54-9494-498e-b70c-c3855f16a3d6 None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:17.060004 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c44dd54-9494-498e-b70c-c3855f16a3d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:17.080954 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.auth.core [None req-5c44dd54-9494-498e-b70c-c3855f16a3d6 None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:26:17.082568 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.fernet_utils [None req-5c44dd54-9494-498e-b70c-c3855f16a3d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:26:17.138565 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b675d6-1376-4530-b714-7c79a0b6d1bd None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:17.163229 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 56/118] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:26:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 08:26:17.164090 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c44dd54-9494-498e-b70c-c3855f16a3d6 None None] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:17.190527 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535ceabf-c46f-4546-bd1c-4a97a1102c76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:17.191340 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535ceabf-c46f-4546-bd1c-4a97a1102c76 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:17.191630 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535ceabf-c46f-4546-bd1c-4a97a1102c76 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:17.191915 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535ceabf-c46f-4546-bd1c-4a97a1102c76 None admin] PATH_INFO: `/v3/users/f12e0800a0284df5b6aec65ab2d4e334` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:17.193286 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535ceabf-c46f-4546-bd1c-4a97a1102c76 None admin] RBAC: Authorizing `identity:get_user(user_id=f12e0800a0284df5b6aec65ab2d4e334)` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:17.194764 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535ceabf-c46f-4546-bd1c-4a97a1102c76 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:17.196555 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 63/119] 10.222.0.62 () {56 vars in 1177 bytes} [Fri May 27 08:26:17 2022] GET /identity/v3/users/f12e0800a0284df5b6aec65ab2d4e334 => generated 275 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:26:17.200819 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956b1fe6-9e46-4106-9125-d3dac06fa935 None None] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:17.200819 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956b1fe6-9e46-4106-9125-d3dac06fa935 None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:17.200819 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956b1fe6-9e46-4106-9125-d3dac06fa935 None None] PATH_INFO: `/` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:17.200819 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 64/120] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:26:17 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:26:17.201468 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956b1fe6-9e46-4106-9125-d3dac06fa935 None None] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:17.206737 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:17.227667 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:17.275851 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c44dd54-9494-498e-b70c-c3855f16a3d6 None None] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:17.313085 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3365d80-d0d2-4bee-be0d-01ad6d1a2d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:17.313961 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3365d80-d0d2-4bee-be0d-01ad6d1a2d70 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:17.314240 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3365d80-d0d2-4bee-be0d-01ad6d1a2d70 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:17.314519 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3365d80-d0d2-4bee-be0d-01ad6d1a2d70 None admin] PATH_INFO: `/v3/projects/befb09928b604b3e89c10a3f78d3aede` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:17.315860 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3365d80-d0d2-4bee-be0d-01ad6d1a2d70 None admin] RBAC: Authorizing `identity:get_project(project_id=befb09928b604b3e89c10a3f78d3aede)` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:17.317213 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3365d80-d0d2-4bee-be0d-01ad6d1a2d70 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:17.319113 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 57/121] 10.222.0.62 () {56 vars in 1186 bytes} [Fri May 27 08:26:17 2022] GET /identity/v3/projects/befb09928b604b3e89c10a3f78d3aede => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:26:17.323776 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956b1fe6-9e46-4106-9125-d3dac06fa935 None None] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:17.324575 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3365d80-d0d2-4bee-be0d-01ad6d1a2d70 None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:17.362442 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59dca4d-490a-44d2-a390-9946096f7a39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:17.363315 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59dca4d-490a-44d2-a390-9946096f7a39 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:17.363596 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59dca4d-490a-44d2-a390-9946096f7a39 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:17.363874 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59dca4d-490a-44d2-a390-9946096f7a39 None admin] PATH_INFO: `/v3/projects/befb09928b604b3e89c10a3f78d3aede` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:17.365545 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59dca4d-490a-44d2-a390-9946096f7a39 None admin] RBAC: Authorizing `identity:get_project(project_id=befb09928b604b3e89c10a3f78d3aede)` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:17.367012 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59dca4d-490a-44d2-a390-9946096f7a39 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:17.368766 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 65/122] 10.222.0.62 () {56 vars in 1186 bytes} [Fri May 27 08:26:17 2022] GET /identity/v3/projects/befb09928b604b3e89c10a3f78d3aede => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:26:17.369542 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59dca4d-490a-44d2-a390-9946096f7a39 None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:17.438633 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3365d80-d0d2-4bee-be0d-01ad6d1a2d70 None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:17.444736 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:17.468783 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:17.480087 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59dca4d-490a-44d2-a390-9946096f7a39 None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:17.480326 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8861d3f7-4af1-4071-9026-c2ffe1b3575f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:17.481289 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8861d3f7-4af1-4071-9026-c2ffe1b3575f None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:17.481581 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8861d3f7-4af1-4071-9026-c2ffe1b3575f None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:17.481868 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8861d3f7-4af1-4071-9026-c2ffe1b3575f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:17.493164 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8861d3f7-4af1-4071-9026-c2ffe1b3575f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 08:26:17.500892 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application [None req-8861d3f7-4af1-4071-9026-c2ffe1b3575f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 08:26:17.500892 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:26:17.500892 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:26:17.500892 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:26:17.500892 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:26:17.500892 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:26:17.500892 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:26:17.500892 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:26:17.500892 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:26:17.500892 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:26:17.500892 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:26:17.500892 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:26:17.500892 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 08:26:17.500892 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 08:26:17.500892 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 08:26:17.500892 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 08:26:17.501782 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 08:26:17.501782 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 08:26:17.501782 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 08:26:17.501782 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 08:26:17.501782 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:26:17.501782 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:26:17.501782 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:26:17.501782 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:26:17.501782 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:26:17.501782 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:26:17.501782 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:26:17.501782 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application with Lock( May 27 08:26:17.501782 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:26:17.501782 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._enter() May 27 08:26:17.501782 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:26:17.501782 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:26:17.508241 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:26:17.508241 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.creator() May 27 08:26:17.508241 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:26:17.508241 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application created_value = creator( May 27 08:26:17.508241 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 08:26:17.508241 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 08:26:17.508241 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 08:26:17.508241 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 08:26:17.508241 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 08:26:17.508241 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 08:26:17.508241 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 08:26:17.508241 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application May 27 08:26:17.508241 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 58/123] 10.222.0.62 () {56 vars in 1096 bytes} [Fri May 27 08:26:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 08:26:17.508241 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e60c11-f65d-4a7f-892a-c9443fe93052 None None] REQUEST_METHOD: `POST` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:17.509199 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e60c11-f65d-4a7f-892a-c9443fe93052 None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:17.509199 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e60c11-f65d-4a7f-892a-c9443fe93052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:17.524564 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050a9f87-75f8-4589-bcdd-6cafd0345c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:17.525295 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.auth.core [None req-79e60c11-f65d-4a7f-892a-c9443fe93052 None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:26:17.525470 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050a9f87-75f8-4589-bcdd-6cafd0345c21 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:17.525740 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050a9f87-75f8-4589-bcdd-6cafd0345c21 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:17.526026 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050a9f87-75f8-4589-bcdd-6cafd0345c21 None admin] PATH_INFO: `/v3/projects/befb09928b604b3e89c10a3f78d3aede` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:17.526505 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.fernet_utils [None req-79e60c11-f65d-4a7f-892a-c9443fe93052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:26:17.527366 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050a9f87-75f8-4589-bcdd-6cafd0345c21 None admin] RBAC: Authorizing `identity:get_project(project_id=befb09928b604b3e89c10a3f78d3aede)` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:17.528886 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050a9f87-75f8-4589-bcdd-6cafd0345c21 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:17.535322 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 66/124] 10.222.0.62 () {56 vars in 1186 bytes} [Fri May 27 08:26:17 2022] GET /identity/v3/projects/befb09928b604b3e89c10a3f78d3aede => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:26:17.535322 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050a9f87-75f8-4589-bcdd-6cafd0345c21 None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:17.599939 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 59/125] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:26:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 08:26:17.601053 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e60c11-f65d-4a7f-892a-c9443fe93052 None None] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:17.657103 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050a9f87-75f8-4589-bcdd-6cafd0345c21 None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:17.698832 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8148b372-85d5-4d7d-b43e-4ee53809e47e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:17.699766 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8148b372-85d5-4d7d-b43e-4ee53809e47e None admin] REQUEST_METHOD: `PUT` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:17.699946 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8148b372-85d5-4d7d-b43e-4ee53809e47e None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:17.700194 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8148b372-85d5-4d7d-b43e-4ee53809e47e None admin] PATH_INFO: `/v3/projects/befb09928b604b3e89c10a3f78d3aede/users/f12e0800a0284df5b6aec65ab2d4e334/roles/c980c64bb84b418daa012ae45a054b37` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:17.702357 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8148b372-85d5-4d7d-b43e-4ee53809e47e None admin] RBAC: Authorizing `identity:create_grant(project_id=befb09928b604b3e89c10a3f78d3aede, user_id=f12e0800a0284df5b6aec65ab2d4e334, role_id=c980c64bb84b418daa012ae45a054b37)` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:17.703746 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8148b372-85d5-4d7d-b43e-4ee53809e47e None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:17.714135 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:17.718895 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 67/126] 10.222.0.62 () {58 vars in 1439 bytes} [Fri May 27 08:26:17 2022] PUT /identity/v3/projects/befb09928b604b3e89c10a3f78d3aede/users/f12e0800a0284df5b6aec65ab2d4e334/roles/c980c64bb84b418daa012ae45a054b37 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 08:26:17.720213 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8148b372-85d5-4d7d-b43e-4ee53809e47e None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:17.725146 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e60c11-f65d-4a7f-892a-c9443fe93052 None None] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:17.750138 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:17.776321 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f007e2cd-ddd0-48e4-b136-9029565e751f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:17.777285 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f007e2cd-ddd0-48e4-b136-9029565e751f None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:17.777711 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f007e2cd-ddd0-48e4-b136-9029565e751f None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:17.778145 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f007e2cd-ddd0-48e4-b136-9029565e751f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:17.779187 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f007e2cd-ddd0-48e4-b136-9029565e751f None admin] RBAC: Adding query filter params (role.id=279cf625eaed4bac893add184f558fd1, scope.project.id=befb09928b604b3e89c10a3f78d3aede, user.id=93f46d0892534f4a84f618904b9f17fb) {{(pid=87172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:26:17.779636 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f007e2cd-ddd0-48e4-b136-9029565e751f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:17.781321 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f007e2cd-ddd0-48e4-b136-9029565e751f None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:17.789803 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 60/127] 10.222.0.62 () {56 vars in 1374 bytes} [Fri May 27 08:26:17 2022] GET /identity/v3/role_assignments?user.id=93f46d0892534f4a84f618904b9f17fb&scope.project.id=befb09928b604b3e89c10a3f78d3aede&role.id=279cf625eaed4bac893add184f558fd1 => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:26:17.790447 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f007e2cd-ddd0-48e4-b136-9029565e751f None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:17.913558 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8148b372-85d5-4d7d-b43e-4ee53809e47e None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:18.005090 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f981bcf1-e524-4a21-9b88-0ed5f76bd121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:18.006072 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f981bcf1-e524-4a21-9b88-0ed5f76bd121 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:18.006259 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f007e2cd-ddd0-48e4-b136-9029565e751f None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:18.006357 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f981bcf1-e524-4a21-9b88-0ed5f76bd121 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:18.006629 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f981bcf1-e524-4a21-9b88-0ed5f76bd121 None admin] PATH_INFO: `/v3/roles` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:18.007402 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f981bcf1-e524-4a21-9b88-0ed5f76bd121 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:26:18.007836 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f981bcf1-e524-4a21-9b88-0ed5f76bd121 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:18.009593 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f981bcf1-e524-4a21-9b88-0ed5f76bd121 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:18.022367 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 68/128] 10.222.0.62 () {56 vars in 1099 bytes} [Fri May 27 08:26:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:26:18.022846 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f981bcf1-e524-4a21-9b88-0ed5f76bd121 None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:18.046967 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5d30af-3bab-415e-a421-77d2c642c406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:18.047865 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5d30af-3bab-415e-a421-77d2c642c406 None admin] REQUEST_METHOD: `PUT` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:18.048153 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5d30af-3bab-415e-a421-77d2c642c406 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:18.048537 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5d30af-3bab-415e-a421-77d2c642c406 None admin] PATH_INFO: `/v3/projects/befb09928b604b3e89c10a3f78d3aede/users/f12e0800a0284df5b6aec65ab2d4e334/roles/9ff71fb5e7b7407d8d243eaa7da0a125` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:18.051073 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5d30af-3bab-415e-a421-77d2c642c406 None admin] RBAC: Authorizing `identity:create_grant(project_id=befb09928b604b3e89c10a3f78d3aede, user_id=f12e0800a0284df5b6aec65ab2d4e334, role_id=9ff71fb5e7b7407d8d243eaa7da0a125)` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:18.053233 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5d30af-3bab-415e-a421-77d2c642c406 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:18.075899 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 61/129] 10.222.0.62 () {58 vars in 1439 bytes} [Fri May 27 08:26:17 2022] PUT /identity/v3/projects/befb09928b604b3e89c10a3f78d3aede/users/f12e0800a0284df5b6aec65ab2d4e334/roles/9ff71fb5e7b7407d8d243eaa7da0a125 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 08:26:18.076801 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5d30af-3bab-415e-a421-77d2c642c406 None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:18.137223 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:18.144885 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:18.231734 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f981bcf1-e524-4a21-9b88-0ed5f76bd121 None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:18.302867 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5d30af-3bab-415e-a421-77d2c642c406 None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:18.317050 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ce9ae8-29f6-4e47-aa6a-3b5905f10f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:18.318407 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ce9ae8-29f6-4e47-aa6a-3b5905f10f71 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:18.318694 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ce9ae8-29f6-4e47-aa6a-3b5905f10f71 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:18.318975 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ce9ae8-29f6-4e47-aa6a-3b5905f10f71 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:18.341641 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ce9ae8-29f6-4e47-aa6a-3b5905f10f71 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 08:26:18.350393 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application [None req-79ce9ae8-29f6-4e47-aa6a-3b5905f10f71 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 08:26:18.350393 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:26:18.350393 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:26:18.350393 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:26:18.350393 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:26:18.350393 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:26:18.350393 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:26:18.350393 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:26:18.350393 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:26:18.350393 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:26:18.350393 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:26:18.350393 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:26:18.350393 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 08:26:18.350393 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 08:26:18.350393 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 08:26:18.350393 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 08:26:18.352961 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 08:26:18.352961 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 08:26:18.352961 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 08:26:18.352961 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 08:26:18.352961 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:26:18.352961 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:26:18.352961 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:26:18.352961 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:26:18.352961 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:26:18.352961 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:26:18.352961 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:26:18.352961 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application with Lock( May 27 08:26:18.352961 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:26:18.352961 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._enter() May 27 08:26:18.352961 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:26:18.352961 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:26:18.355041 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:26:18.355041 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.creator() May 27 08:26:18.355041 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:26:18.355041 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application created_value = creator( May 27 08:26:18.355041 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 08:26:18.355041 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 08:26:18.355041 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 08:26:18.355041 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 08:26:18.355041 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 08:26:18.355041 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 08:26:18.355041 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 08:26:18.355041 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application May 27 08:26:18.355041 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 69/130] 10.222.0.62 () {56 vars in 1099 bytes} [Fri May 27 08:26:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 08:26:18.357933 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ce9ae8-29f6-4e47-aa6a-3b5905f10f71 None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:18.406775 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0253acee-e81b-4788-a3d1-2d1616c948c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:18.408275 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0253acee-e81b-4788-a3d1-2d1616c948c5 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:18.408817 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0253acee-e81b-4788-a3d1-2d1616c948c5 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:18.409246 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0253acee-e81b-4788-a3d1-2d1616c948c5 None admin] PATH_INFO: `/v3/users/ca179b0a3ab4467ba61f4e713c6eb763` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:18.413471 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0253acee-e81b-4788-a3d1-2d1616c948c5 None admin] RBAC: Authorizing `identity:get_user(user_id=ca179b0a3ab4467ba61f4e713c6eb763)` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:18.415390 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0253acee-e81b-4788-a3d1-2d1616c948c5 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:18.417549 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 62/131] 10.222.0.62 () {56 vars in 1177 bytes} [Fri May 27 08:26:18 2022] GET /identity/v3/users/ca179b0a3ab4467ba61f4e713c6eb763 => generated 247 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:26:18.423207 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0253acee-e81b-4788-a3d1-2d1616c948c5 None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:18.482189 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ce9ae8-29f6-4e47-aa6a-3b5905f10f71 None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:18.509924 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:18.531639 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7b2589-6ce7-4c8c-8afe-8d635255c06f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:18.532321 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7b2589-6ce7-4c8c-8afe-8d635255c06f None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:18.532626 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7b2589-6ce7-4c8c-8afe-8d635255c06f None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:18.532910 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7b2589-6ce7-4c8c-8afe-8d635255c06f None admin] PATH_INFO: `/v3/roles` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:18.533740 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7b2589-6ce7-4c8c-8afe-8d635255c06f None admin] RBAC: Adding query filter params (name=member) {{(pid=87173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:26:18.534052 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7b2589-6ce7-4c8c-8afe-8d635255c06f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:18.535459 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7b2589-6ce7-4c8c-8afe-8d635255c06f None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:18.544677 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 70/132] 10.222.0.62 () {56 vars in 1101 bytes} [Fri May 27 08:26:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 08:26:18.552093 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7b2589-6ce7-4c8c-8afe-8d635255c06f None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:18.627283 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0253acee-e81b-4788-a3d1-2d1616c948c5 None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:18.639441 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:18.679568 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7b2589-6ce7-4c8c-8afe-8d635255c06f None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:18.689319 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7969089c-2549-42c4-b755-3b899d071cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:18.690200 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7969089c-2549-42c4-b755-3b899d071cd4 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:18.690491 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7969089c-2549-42c4-b755-3b899d071cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:18.690772 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7969089c-2549-42c4-b755-3b899d071cd4 None admin] PATH_INFO: `/v3/projects/befb09928b604b3e89c10a3f78d3aede` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:18.695757 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7969089c-2549-42c4-b755-3b899d071cd4 None admin] RBAC: Authorizing `identity:get_project(project_id=befb09928b604b3e89c10a3f78d3aede)` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:18.697310 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7969089c-2549-42c4-b755-3b899d071cd4 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:18.699288 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 63/133] 10.222.0.62 () {56 vars in 1186 bytes} [Fri May 27 08:26:18 2022] GET /identity/v3/projects/befb09928b604b3e89c10a3f78d3aede => generated 298 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 08:26:18.705088 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7969089c-2549-42c4-b755-3b899d071cd4 None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:18.748235 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b45dee-a6ca-4a48-9c65-81ed0169c85f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:18.749173 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b45dee-a6ca-4a48-9c65-81ed0169c85f None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:18.749472 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b45dee-a6ca-4a48-9c65-81ed0169c85f None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:18.751279 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b45dee-a6ca-4a48-9c65-81ed0169c85f None admin] PATH_INFO: `/v3/users/f12e0800a0284df5b6aec65ab2d4e334` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:18.752543 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b45dee-a6ca-4a48-9c65-81ed0169c85f None admin] RBAC: Authorizing `identity:get_user(user_id=f12e0800a0284df5b6aec65ab2d4e334)` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:18.754057 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b45dee-a6ca-4a48-9c65-81ed0169c85f None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:18.757849 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 71/134] 10.222.0.62 () {56 vars in 1177 bytes} [Fri May 27 08:26:18 2022] GET /identity/v3/users/f12e0800a0284df5b6aec65ab2d4e334 => generated 275 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:26:18.768146 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b45dee-a6ca-4a48-9c65-81ed0169c85f None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:18.831502 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:18.884669 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b45dee-a6ca-4a48-9c65-81ed0169c85f None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:18.896410 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7969089c-2549-42c4-b755-3b899d071cd4 None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:18.921199 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4882a9-a611-4dcb-a58d-6da29883a37e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:18.922069 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4882a9-a611-4dcb-a58d-6da29883a37e None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:18.922361 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4882a9-a611-4dcb-a58d-6da29883a37e None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:18.922677 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4882a9-a611-4dcb-a58d-6da29883a37e None admin] PATH_INFO: `/v3/projects/4698f614e26e44578837f8500ed63ba9` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:18.923953 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4882a9-a611-4dcb-a58d-6da29883a37e None admin] RBAC: Authorizing `identity:get_project(project_id=4698f614e26e44578837f8500ed63ba9)` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:18.925370 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4882a9-a611-4dcb-a58d-6da29883a37e None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:18.927375 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 72/135] 10.222.0.62 () {56 vars in 1186 bytes} [Fri May 27 08:26:18 2022] GET /identity/v3/projects/4698f614e26e44578837f8500ed63ba9 => generated 312 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:26:18.928416 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbf8342-f80e-42e9-af86-05d149cc6789 None None] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:18.932803 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbf8342-f80e-42e9-af86-05d149cc6789 None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:18.933139 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbf8342-f80e-42e9-af86-05d149cc6789 None None] PATH_INFO: `/` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:18.934695 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 73/136] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:26:18 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:26:18.936045 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbf8342-f80e-42e9-af86-05d149cc6789 None None] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:18.950414 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f460c97e-b148-4384-af71-dcf5e7c6f5ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:18.951661 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f460c97e-b148-4384-af71-dcf5e7c6f5ec None admin] REQUEST_METHOD: `PUT` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:18.952194 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f460c97e-b148-4384-af71-dcf5e7c6f5ec None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:18.952802 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f460c97e-b148-4384-af71-dcf5e7c6f5ec None admin] PATH_INFO: `/v3/projects/befb09928b604b3e89c10a3f78d3aede/users/ca179b0a3ab4467ba61f4e713c6eb763/roles/5e6f243a7201412c965e7c70249d4dc0` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:18.955645 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f460c97e-b148-4384-af71-dcf5e7c6f5ec None admin] RBAC: Authorizing `identity:create_grant(project_id=befb09928b604b3e89c10a3f78d3aede, user_id=ca179b0a3ab4467ba61f4e713c6eb763, role_id=5e6f243a7201412c965e7c70249d4dc0)` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:18.957709 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f460c97e-b148-4384-af71-dcf5e7c6f5ec None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:18.978097 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 64/137] 10.222.0.62 () {58 vars in 1439 bytes} [Fri May 27 08:26:18 2022] PUT /identity/v3/projects/befb09928b604b3e89c10a3f78d3aede/users/ca179b0a3ab4467ba61f4e713c6eb763/roles/5e6f243a7201412c965e7c70249d4dc0 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 08:26:18.979798 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1423b7f-4545-4be8-a8e6-68a4628575c8 None None] REQUEST_METHOD: `POST` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:18.980328 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1423b7f-4545-4be8-a8e6-68a4628575c8 None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:18.980881 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1423b7f-4545-4be8-a8e6-68a4628575c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:19.013214 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.auth.core [None req-a1423b7f-4545-4be8-a8e6-68a4628575c8 None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:26:19.014750 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.fernet_utils [None req-a1423b7f-4545-4be8-a8e6-68a4628575c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:26:19.066202 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:19.103145 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbf8342-f80e-42e9-af86-05d149cc6789 None None] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:19.121586 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:19.145259 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d7650b-16cd-4c47-9330-38f0ed11083f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:19.146239 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d7650b-16cd-4c47-9330-38f0ed11083f None admin] REQUEST_METHOD: `PUT` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:19.146588 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d7650b-16cd-4c47-9330-38f0ed11083f None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:19.148304 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d7650b-16cd-4c47-9330-38f0ed11083f None admin] PATH_INFO: `/v3/projects/4698f614e26e44578837f8500ed63ba9/users/f12e0800a0284df5b6aec65ab2d4e334/roles/c980c64bb84b418daa012ae45a054b37` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:19.151855 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d7650b-16cd-4c47-9330-38f0ed11083f None admin] RBAC: Authorizing `identity:create_grant(project_id=4698f614e26e44578837f8500ed63ba9, user_id=f12e0800a0284df5b6aec65ab2d4e334, role_id=c980c64bb84b418daa012ae45a054b37)` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:19.156658 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 65/138] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:26:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 08:26:19.157499 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d7650b-16cd-4c47-9330-38f0ed11083f None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:19.180127 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 74/139] 10.222.0.62 () {58 vars in 1439 bytes} [Fri May 27 08:26:18 2022] PUT /identity/v3/projects/4698f614e26e44578837f8500ed63ba9/users/f12e0800a0284df5b6aec65ab2d4e334/roles/c980c64bb84b418daa012ae45a054b37 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 08:26:19.210312 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1423b7f-4545-4be8-a8e6-68a4628575c8 None None] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:19.356815 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1423b7f-4545-4be8-a8e6-68a4628575c8 None None] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:19.410030 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3509e2b8-dd0a-432c-885b-7990b434b803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:19.410767 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3509e2b8-dd0a-432c-885b-7990b434b803 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:19.411121 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3509e2b8-dd0a-432c-885b-7990b434b803 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:19.411401 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3509e2b8-dd0a-432c-885b-7990b434b803 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:19.417655 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3509e2b8-dd0a-432c-885b-7990b434b803 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:19.419202 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3509e2b8-dd0a-432c-885b-7990b434b803 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:19.421032 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 66/140] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 08:26:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:26:19.427615 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d7650b-16cd-4c47-9330-38f0ed11083f None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:19.580798 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d7650b-16cd-4c47-9330-38f0ed11083f None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:19.627505 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713dbb23-a48f-4a7f-bc66-9753f26bbd57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:19.628216 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713dbb23-a48f-4a7f-bc66-9753f26bbd57 None admin] REQUEST_METHOD: `POST` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:19.628499 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713dbb23-a48f-4a7f-bc66-9753f26bbd57 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:19.628815 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713dbb23-a48f-4a7f-bc66-9753f26bbd57 None admin] PATH_INFO: `/v3/users` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:19.629553 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713dbb23-a48f-4a7f-bc66-9753f26bbd57 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:19.631631 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713dbb23-a48f-4a7f-bc66-9753f26bbd57 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:19.668640 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 75/141] 10.222.0.62 () {60 vars in 1132 bytes} [Fri May 27 08:26:19 2022] POST /identity/v3/users => generated 283 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 08:26:20.712961 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e3c901-b618-4991-bf10-7a72fa60085c None None] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:20.713459 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e3c901-b618-4991-bf10-7a72fa60085c None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:20.713565 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e3c901-b618-4991-bf10-7a72fa60085c None None] PATH_INFO: `/` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:20.715046 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 67/142] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:26:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:26:20.721098 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc75d6dc-64e5-43a6-85c7-d3fad0152c89 None None] REQUEST_METHOD: `POST` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:20.721544 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc75d6dc-64e5-43a6-85c7-d3fad0152c89 None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:20.721723 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc75d6dc-64e5-43a6-85c7-d3fad0152c89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:20.753930 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.auth.core [None req-cc75d6dc-64e5-43a6-85c7-d3fad0152c89 None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:26:20.755184 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.fernet_utils [None req-cc75d6dc-64e5-43a6-85c7-d3fad0152c89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:26:20.808342 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:20.853399 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 76/143] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:26:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 08:26:20.891334 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e3c901-b618-4991-bf10-7a72fa60085c None None] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:20.931714 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:21.026362 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e3c901-b618-4991-bf10-7a72fa60085c None None] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:21.070502 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a4ae64-4bda-4c63-9adc-5718bfe5f94f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:21.071300 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a4ae64-4bda-4c63-9adc-5718bfe5f94f None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:21.071587 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a4ae64-4bda-4c63-9adc-5718bfe5f94f None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:21.071863 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a4ae64-4bda-4c63-9adc-5718bfe5f94f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:21.088749 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a4ae64-4bda-4c63-9adc-5718bfe5f94f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 08:26:21.099723 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application [None req-68a4ae64-4bda-4c63-9adc-5718bfe5f94f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 27 08:26:21.099723 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:26:21.099723 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:26:21.099723 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:26:21.099723 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:26:21.099723 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:26:21.099723 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:26:21.099723 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:26:21.099723 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:26:21.099723 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:26:21.099723 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:26:21.099723 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:26:21.099723 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 08:26:21.099723 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 08:26:21.099723 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 08:26:21.099723 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 08:26:21.100755 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 08:26:21.100755 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 08:26:21.100755 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 08:26:21.100755 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 08:26:21.100755 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:26:21.100755 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:26:21.100755 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:26:21.100755 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:26:21.100755 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:26:21.100755 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:26:21.100755 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:26:21.100755 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application with Lock( May 27 08:26:21.100755 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:26:21.100755 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._enter() May 27 08:26:21.100755 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:26:21.100755 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:26:21.101519 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:26:21.101519 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.creator() May 27 08:26:21.101519 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:26:21.101519 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application created_value = creator( May 27 08:26:21.101519 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 08:26:21.101519 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 08:26:21.101519 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 08:26:21.101519 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 08:26:21.101519 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 08:26:21.101519 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 08:26:21.101519 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 27 08:26:21.101519 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application May 27 08:26:21.101519 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 68/144] 10.222.0.62 () {56 vars in 1099 bytes} [Fri May 27 08:26:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 08:26:21.109719 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc75d6dc-64e5-43a6-85c7-d3fad0152c89 None None] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:21.259047 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc75d6dc-64e5-43a6-85c7-d3fad0152c89 None None] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:21.298371 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e518ce9-b25f-49f2-affd-d32bcbecd702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:21.299064 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e518ce9-b25f-49f2-affd-d32bcbecd702 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:21.299350 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e518ce9-b25f-49f2-affd-d32bcbecd702 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:21.299627 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e518ce9-b25f-49f2-affd-d32bcbecd702 None admin] PATH_INFO: `/v3/roles` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:21.300396 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e518ce9-b25f-49f2-affd-d32bcbecd702 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:26:21.300731 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e518ce9-b25f-49f2-affd-d32bcbecd702 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:21.302685 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e518ce9-b25f-49f2-affd-d32bcbecd702 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:21.314511 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 77/145] 10.222.0.62 () {56 vars in 1101 bytes} [Fri May 27 08:26:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:26:21.322518 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a4ae64-4bda-4c63-9adc-5718bfe5f94f None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:21.469159 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:21.482535 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a4ae64-4bda-4c63-9adc-5718bfe5f94f None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:21.523490 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98410bba-82bc-4b72-8859-c5a40f663ccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:21.524752 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98410bba-82bc-4b72-8859-c5a40f663ccc None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:21.525244 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98410bba-82bc-4b72-8859-c5a40f663ccc None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:21.525744 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98410bba-82bc-4b72-8859-c5a40f663ccc None admin] PATH_INFO: `/v3/users/93f46d0892534f4a84f618904b9f17fb` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:21.527240 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98410bba-82bc-4b72-8859-c5a40f663ccc None admin] RBAC: Authorizing `identity:get_user(user_id=93f46d0892534f4a84f618904b9f17fb)` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:21.528955 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98410bba-82bc-4b72-8859-c5a40f663ccc None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:21.530829 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 69/146] 10.222.0.62 () {56 vars in 1177 bytes} [Fri May 27 08:26:21 2022] GET /identity/v3/users/93f46d0892534f4a84f618904b9f17fb => generated 289 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:26:21.536512 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e518ce9-b25f-49f2-affd-d32bcbecd702 None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:21.584082 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:21.693220 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e518ce9-b25f-49f2-affd-d32bcbecd702 None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:21.736944 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28085506-b270-4fac-8339-0cce462a0b52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:21.737838 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28085506-b270-4fac-8339-0cce462a0b52 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:21.738124 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28085506-b270-4fac-8339-0cce462a0b52 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:21.738401 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28085506-b270-4fac-8339-0cce462a0b52 None admin] PATH_INFO: `/v3/projects/befb09928b604b3e89c10a3f78d3aede` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:21.745644 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28085506-b270-4fac-8339-0cce462a0b52 None admin] RBAC: Authorizing `identity:get_project(project_id=befb09928b604b3e89c10a3f78d3aede)` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:21.747187 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28085506-b270-4fac-8339-0cce462a0b52 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:21.749121 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 78/147] 10.222.0.62 () {56 vars in 1186 bytes} [Fri May 27 08:26:21 2022] GET /identity/v3/projects/befb09928b604b3e89c10a3f78d3aede => generated 298 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:26:21.755392 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98410bba-82bc-4b72-8859-c5a40f663ccc None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:21.914593 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98410bba-82bc-4b72-8859-c5a40f663ccc None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:21.981330 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c4a80e-a173-4ffa-8ba2-05d384928192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:21.982303 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c4a80e-a173-4ffa-8ba2-05d384928192 None admin] REQUEST_METHOD: `PUT` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:21.982612 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c4a80e-a173-4ffa-8ba2-05d384928192 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:21.982883 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c4a80e-a173-4ffa-8ba2-05d384928192 None admin] PATH_INFO: `/v3/projects/befb09928b604b3e89c10a3f78d3aede/users/93f46d0892534f4a84f618904b9f17fb/roles/279cf625eaed4bac893add184f558fd1` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:21.985046 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c4a80e-a173-4ffa-8ba2-05d384928192 None admin] RBAC: Authorizing `identity:create_grant(project_id=befb09928b604b3e89c10a3f78d3aede, user_id=93f46d0892534f4a84f618904b9f17fb, role_id=279cf625eaed4bac893add184f558fd1)` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:21.986512 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c4a80e-a173-4ffa-8ba2-05d384928192 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:22.008512 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 70/148] 10.222.0.62 () {58 vars in 1439 bytes} [Fri May 27 08:26:21 2022] PUT /identity/v3/projects/befb09928b604b3e89c10a3f78d3aede/users/93f46d0892534f4a84f618904b9f17fb/roles/279cf625eaed4bac893add184f558fd1 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 08:26:22.131086 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f20171d-df18-406b-b4f4-b3b967794125 None None] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:22.131507 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f20171d-df18-406b-b4f4-b3b967794125 None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:22.131679 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f20171d-df18-406b-b4f4-b3b967794125 None None] PATH_INFO: `/` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:22.133141 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 79/149] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:26:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:26:22.143151 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d3c881-f5d3-4b89-9d3d-ff02a6b27e96 None None] REQUEST_METHOD: `POST` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:22.143487 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d3c881-f5d3-4b89-9d3d-ff02a6b27e96 None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:22.143825 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d3c881-f5d3-4b89-9d3d-ff02a6b27e96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:22.172050 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.auth.core [None req-b1d3c881-f5d3-4b89-9d3d-ff02a6b27e96 None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:26:22.173261 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.fernet_utils [None req-b1d3c881-f5d3-4b89-9d3d-ff02a6b27e96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:26:22.194298 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:22.261019 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 71/150] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:26:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 08:26:22.290575 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f20171d-df18-406b-b4f4-b3b967794125 None None] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:22.398123 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:22.405824 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f20171d-df18-406b-b4f4-b3b967794125 None None] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:22.447883 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c5c63a-3d5c-4cd8-80fd-d6251818df85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:22.448661 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c5c63a-3d5c-4cd8-80fd-d6251818df85 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:22.448947 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c5c63a-3d5c-4cd8-80fd-d6251818df85 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:22.449278 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c5c63a-3d5c-4cd8-80fd-d6251818df85 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:22.462961 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c5c63a-3d5c-4cd8-80fd-d6251818df85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 08:26:22.472183 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application [None req-68c5c63a-3d5c-4cd8-80fd-d6251818df85 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 08:26:22.472183 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:26:22.472183 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:26:22.472183 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:26:22.472183 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:26:22.472183 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:26:22.472183 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:26:22.472183 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:26:22.472183 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:26:22.472183 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:26:22.472183 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:26:22.472183 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:26:22.472183 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 08:26:22.472183 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 08:26:22.472183 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 08:26:22.472183 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 08:26:22.475208 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 08:26:22.475208 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 08:26:22.475208 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 08:26:22.475208 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 08:26:22.475208 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:26:22.475208 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:26:22.475208 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:26:22.475208 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:26:22.475208 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:26:22.475208 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:26:22.475208 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:26:22.475208 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application with Lock( May 27 08:26:22.475208 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:26:22.475208 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._enter() May 27 08:26:22.475208 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:26:22.475208 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:26:22.476680 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:26:22.476680 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.creator() May 27 08:26:22.476680 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:26:22.476680 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application created_value = creator( May 27 08:26:22.476680 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 08:26:22.476680 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 08:26:22.476680 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 08:26:22.476680 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 08:26:22.476680 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 08:26:22.476680 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 08:26:22.476680 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 08:26:22.476680 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application May 27 08:26:22.476680 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 80/151] 10.222.0.62 () {56 vars in 1114 bytes} [Fri May 27 08:26:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 08:26:22.497353 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d3c881-f5d3-4b89-9d3d-ff02a6b27e96 None None] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:22.582138 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874bf5dd-68d1-4706-a596-9d7422b01f93 None None] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:22.582455 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874bf5dd-68d1-4706-a596-9d7422b01f93 None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:22.583222 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874bf5dd-68d1-4706-a596-9d7422b01f93 None None] PATH_INFO: `/` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:22.584988 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 81/152] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:26:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 08:26:22.591344 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94599c17-aced-4ee4-8fd9-86fb735d2c1c None None] REQUEST_METHOD: `POST` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:22.591645 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94599c17-aced-4ee4-8fd9-86fb735d2c1c None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:22.591994 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94599c17-aced-4ee4-8fd9-86fb735d2c1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:22.623039 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.auth.core [None req-94599c17-aced-4ee4-8fd9-86fb735d2c1c None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:26:22.624277 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.fernet_utils [None req-94599c17-aced-4ee4-8fd9-86fb735d2c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:26:22.650553 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d3c881-f5d3-4b89-9d3d-ff02a6b27e96 None None] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:22.745453 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbff44b6-d9e3-4260-9553-a3d7c30ca9c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:22.746384 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbff44b6-d9e3-4260-9553-a3d7c30ca9c3 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:22.746814 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbff44b6-d9e3-4260-9553-a3d7c30ca9c3 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:22.747234 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbff44b6-d9e3-4260-9553-a3d7c30ca9c3 None admin] PATH_INFO: `/v3/roles` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:22.748154 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbff44b6-d9e3-4260-9553-a3d7c30ca9c3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:26:22.748622 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbff44b6-d9e3-4260-9553-a3d7c30ca9c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:22.750382 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbff44b6-d9e3-4260-9553-a3d7c30ca9c3 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:22.756781 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 82/153] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:26:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 08:26:22.758992 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1526e328-9fde-4c7e-aedf-275eb69bf02f None None] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:22.759294 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1526e328-9fde-4c7e-aedf-275eb69bf02f None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:22.759639 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1526e328-9fde-4c7e-aedf-275eb69bf02f None None] PATH_INFO: `/` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:22.761305 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 83/154] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:26:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:26:22.766934 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830b1578-3159-4464-8f00-09241395357f None None] REQUEST_METHOD: `POST` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:22.767249 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830b1578-3159-4464-8f00-09241395357f None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:22.767637 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830b1578-3159-4464-8f00-09241395357f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:22.769622 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 72/155] 10.222.0.62 () {56 vars in 1111 bytes} [Fri May 27 08:26:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:26:22.776011 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbff44b6-d9e3-4260-9553-a3d7c30ca9c3 None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:22.795391 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.auth.core [None req-830b1578-3159-4464-8f00-09241395357f None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:26:22.796680 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.fernet_utils [None req-830b1578-3159-4464-8f00-09241395357f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:26:22.804431 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:22.893183 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 84/156] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:26:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 08:26:22.894012 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830b1578-3159-4464-8f00-09241395357f None None] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:22.933911 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:22.986332 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbff44b6-d9e3-4260-9553-a3d7c30ca9c3 None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:23.022264 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830b1578-3159-4464-8f00-09241395357f None None] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:23.023654 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8b01aa-af07-4f17-b5bd-3846ef54b99f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:23.024642 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8b01aa-af07-4f17-b5bd-3846ef54b99f None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:23.024938 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8b01aa-af07-4f17-b5bd-3846ef54b99f None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:23.025267 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8b01aa-af07-4f17-b5bd-3846ef54b99f None admin] PATH_INFO: `/v3/users/f12e0800a0284df5b6aec65ab2d4e334` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:23.026523 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8b01aa-af07-4f17-b5bd-3846ef54b99f None admin] RBAC: Authorizing `identity:get_user(user_id=f12e0800a0284df5b6aec65ab2d4e334)` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:23.028018 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8b01aa-af07-4f17-b5bd-3846ef54b99f None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:23.030084 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 73/157] 10.222.0.62 () {56 vars in 1177 bytes} [Fri May 27 08:26:22 2022] GET /identity/v3/users/f12e0800a0284df5b6aec65ab2d4e334 => generated 275 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:26:23.030882 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8b01aa-af07-4f17-b5bd-3846ef54b99f None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:23.070845 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6513208e-2eef-41e1-aad9-8b5fab804d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:23.071663 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6513208e-2eef-41e1-aad9-8b5fab804d92 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:23.071946 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6513208e-2eef-41e1-aad9-8b5fab804d92 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:23.072209 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6513208e-2eef-41e1-aad9-8b5fab804d92 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:23.084346 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6513208e-2eef-41e1-aad9-8b5fab804d92 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 08:26:23.092536 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application [None req-6513208e-2eef-41e1-aad9-8b5fab804d92 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 08:26:23.092536 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:26:23.092536 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:26:23.092536 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:26:23.092536 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:26:23.092536 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:26:23.092536 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:26:23.092536 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:26:23.092536 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:26:23.092536 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:26:23.092536 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:26:23.092536 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:26:23.092536 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 08:26:23.092536 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 08:26:23.092536 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 08:26:23.092536 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 08:26:23.093520 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 08:26:23.093520 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 08:26:23.093520 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 08:26:23.093520 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 08:26:23.093520 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:26:23.093520 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:26:23.093520 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:26:23.093520 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:26:23.093520 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:26:23.093520 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:26:23.093520 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:26:23.093520 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application with Lock( May 27 08:26:23.093520 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:26:23.093520 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._enter() May 27 08:26:23.093520 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:26:23.093520 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:26:23.094294 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:26:23.094294 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.creator() May 27 08:26:23.094294 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:26:23.094294 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application created_value = creator( May 27 08:26:23.094294 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 08:26:23.094294 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 08:26:23.094294 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 08:26:23.094294 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 08:26:23.094294 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 08:26:23.094294 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 08:26:23.094294 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 08:26:23.094294 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application May 27 08:26:23.094294 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 85/158] 10.222.0.62 () {56 vars in 1096 bytes} [Fri May 27 08:26:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 08:26:23.094919 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6513208e-2eef-41e1-aad9-8b5fab804d92 None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:23.126195 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:23.147455 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8b01aa-af07-4f17-b5bd-3846ef54b99f None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:23.184457 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba344e0-62ce-4f71-987b-028c316cf9cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:23.185421 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba344e0-62ce-4f71-987b-028c316cf9cd None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:23.185869 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba344e0-62ce-4f71-987b-028c316cf9cd None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:23.186222 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba344e0-62ce-4f71-987b-028c316cf9cd None admin] PATH_INFO: `/v3/roles/member` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:23.198088 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba344e0-62ce-4f71-987b-028c316cf9cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 08:26:23.206142 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application [None req-4ba344e0-62ce-4f71-987b-028c316cf9cd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 08:26:23.206142 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:26:23.206142 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:26:23.206142 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:26:23.206142 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:26:23.206142 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:26:23.206142 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:26:23.206142 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:26:23.206142 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:26:23.206142 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:26:23.206142 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:26:23.206142 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:26:23.206142 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 08:26:23.206142 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 08:26:23.206142 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 08:26:23.206142 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 08:26:23.207045 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 08:26:23.207045 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 08:26:23.207045 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 08:26:23.207045 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 08:26:23.207045 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:26:23.207045 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:26:23.207045 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:26:23.207045 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:26:23.207045 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:26:23.207045 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:26:23.207045 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:26:23.207045 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application with Lock( May 27 08:26:23.207045 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:26:23.207045 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._enter() May 27 08:26:23.207045 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:26:23.207045 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:26:23.208506 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:26:23.208506 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.creator() May 27 08:26:23.208506 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:26:23.208506 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application created_value = creator( May 27 08:26:23.208506 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 08:26:23.208506 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 08:26:23.208506 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 08:26:23.208506 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 08:26:23.208506 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 08:26:23.208506 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 08:26:23.208506 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 08:26:23.208506 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application May 27 08:26:23.208506 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 74/159] 10.222.0.62 () {56 vars in 1099 bytes} [Fri May 27 08:26:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 08:26:23.209524 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba344e0-62ce-4f71-987b-028c316cf9cd None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:23.241179 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:23.299926 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6513208e-2eef-41e1-aad9-8b5fab804d92 None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:23.390625 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48b687e-1376-4495-aeb5-74923a436ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:23.391286 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48b687e-1376-4495-aeb5-74923a436ad1 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:23.391567 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48b687e-1376-4495-aeb5-74923a436ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:23.391845 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48b687e-1376-4495-aeb5-74923a436ad1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:23.442208 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba344e0-62ce-4f71-987b-028c316cf9cd None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:23.498140 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a237d923-cb76-4e5f-9f1d-fbeee080a084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:23.499148 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a237d923-cb76-4e5f-9f1d-fbeee080a084 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:23.499437 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a237d923-cb76-4e5f-9f1d-fbeee080a084 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:23.499720 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a237d923-cb76-4e5f-9f1d-fbeee080a084 None admin] PATH_INFO: `/v3/roles` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:23.500514 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a237d923-cb76-4e5f-9f1d-fbeee080a084 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:26:23.501244 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a237d923-cb76-4e5f-9f1d-fbeee080a084 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:23.502651 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a237d923-cb76-4e5f-9f1d-fbeee080a084 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:23.513172 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 75/160] 10.222.0.62 () {56 vars in 1099 bytes} [Fri May 27 08:26:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:26:23.518000 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a237d923-cb76-4e5f-9f1d-fbeee080a084 None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:23.520957 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:23.546954 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48b687e-1376-4495-aeb5-74923a436ad1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:23.548559 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48b687e-1376-4495-aeb5-74923a436ad1 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:23.661170 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:23.685718 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a237d923-cb76-4e5f-9f1d-fbeee080a084 None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:23.690397 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 86/161] 10.222.0.62 () {58 vars in 1282 bytes} [Fri May 27 08:26:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 596 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 08:26:23.691605 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48b687e-1376-4495-aeb5-74923a436ad1 None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:23.751577 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433f6a0f-95eb-481a-a4f5-40b826cad874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:23.751947 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433f6a0f-95eb-481a-a4f5-40b826cad874 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:23.752343 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433f6a0f-95eb-481a-a4f5-40b826cad874 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:23.752705 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433f6a0f-95eb-481a-a4f5-40b826cad874 None admin] PATH_INFO: `/v3/roles` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:23.753542 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433f6a0f-95eb-481a-a4f5-40b826cad874 None admin] RBAC: Adding query filter params (name=member) {{(pid=87172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:26:23.753891 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433f6a0f-95eb-481a-a4f5-40b826cad874 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:23.755997 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433f6a0f-95eb-481a-a4f5-40b826cad874 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:23.770691 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 76/162] 10.222.0.62 () {56 vars in 1101 bytes} [Fri May 27 08:26:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:26:23.772091 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433f6a0f-95eb-481a-a4f5-40b826cad874 None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:23.824079 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48b687e-1376-4495-aeb5-74923a436ad1 None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:23.850345 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:23.869687 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fb9d7d-f789-4237-a5f1-21d757a44c94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:23.870892 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fb9d7d-f789-4237-a5f1-21d757a44c94 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:23.871354 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fb9d7d-f789-4237-a5f1-21d757a44c94 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:23.871807 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fb9d7d-f789-4237-a5f1-21d757a44c94 None admin] PATH_INFO: `/v3/users/ca179b0a3ab4467ba61f4e713c6eb763` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:23.873447 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fb9d7d-f789-4237-a5f1-21d757a44c94 None admin] RBAC: Authorizing `identity:get_user(user_id=ca179b0a3ab4467ba61f4e713c6eb763)` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:23.875180 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fb9d7d-f789-4237-a5f1-21d757a44c94 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:23.877220 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 87/163] 10.222.0.62 () {56 vars in 1177 bytes} [Fri May 27 08:26:23 2022] GET /identity/v3/users/ca179b0a3ab4467ba61f4e713c6eb763 => generated 247 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:26:23.878308 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fb9d7d-f789-4237-a5f1-21d757a44c94 None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:23.906647 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433f6a0f-95eb-481a-a4f5-40b826cad874 None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:23.936420 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:23.950776 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b132d55c-50d7-462f-bf14-726533fc2cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:23.951772 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b132d55c-50d7-462f-bf14-726533fc2cda None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:23.952126 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b132d55c-50d7-462f-bf14-726533fc2cda None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:23.952471 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b132d55c-50d7-462f-bf14-726533fc2cda None admin] PATH_INFO: `/v3/projects/befb09928b604b3e89c10a3f78d3aede` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:23.956651 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b132d55c-50d7-462f-bf14-726533fc2cda None admin] RBAC: Authorizing `identity:get_project(project_id=befb09928b604b3e89c10a3f78d3aede)` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:23.959300 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b132d55c-50d7-462f-bf14-726533fc2cda None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:23.961534 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 77/164] 10.222.0.62 () {56 vars in 1186 bytes} [Fri May 27 08:26:23 2022] GET /identity/v3/projects/befb09928b604b3e89c10a3f78d3aede => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:26:23.962201 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b132d55c-50d7-462f-bf14-726533fc2cda None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:24.001721 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fb9d7d-f789-4237-a5f1-21d757a44c94 None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:24.041445 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bf0800-aa87-41d9-bc75-09853733af4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:24.042670 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bf0800-aa87-41d9-bc75-09853733af4e None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:24.043133 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bf0800-aa87-41d9-bc75-09853733af4e None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:24.043613 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bf0800-aa87-41d9-bc75-09853733af4e None admin] PATH_INFO: `/v3/users/f12e0800a0284df5b6aec65ab2d4e334` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:24.045082 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bf0800-aa87-41d9-bc75-09853733af4e None admin] RBAC: Authorizing `identity:get_user(user_id=f12e0800a0284df5b6aec65ab2d4e334)` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:24.046916 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bf0800-aa87-41d9-bc75-09853733af4e None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:24.049124 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 88/165] 10.222.0.62 () {56 vars in 1177 bytes} [Fri May 27 08:26:23 2022] GET /identity/v3/users/f12e0800a0284df5b6aec65ab2d4e334 => generated 275 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:26:24.050369 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bf0800-aa87-41d9-bc75-09853733af4e None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:24.088894 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b132d55c-50d7-462f-bf14-726533fc2cda None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:24.131592 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:24.146765 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fb6149-4395-4f91-99e5-5284c34f17a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:24.147640 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fb6149-4395-4f91-99e5-5284c34f17a6 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:24.147751 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fb6149-4395-4f91-99e5-5284c34f17a6 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:24.148004 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fb6149-4395-4f91-99e5-5284c34f17a6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:24.168666 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bf0800-aa87-41d9-bc75-09853733af4e None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:24.183710 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:24.209866 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed1f3f8-9819-4b65-8d58-5ef41beb6be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:24.210926 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed1f3f8-9819-4b65-8d58-5ef41beb6be8 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:24.211410 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed1f3f8-9819-4b65-8d58-5ef41beb6be8 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:24.211912 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed1f3f8-9819-4b65-8d58-5ef41beb6be8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:24.213165 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed1f3f8-9819-4b65-8d58-5ef41beb6be8 None admin] RBAC: Adding query filter params (role.id=9ff71fb5e7b7407d8d243eaa7da0a125, scope.project.id=befb09928b604b3e89c10a3f78d3aede, user.id=f12e0800a0284df5b6aec65ab2d4e334) {{(pid=87173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:26:24.213748 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed1f3f8-9819-4b65-8d58-5ef41beb6be8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:24.215421 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed1f3f8-9819-4b65-8d58-5ef41beb6be8 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:24.231381 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 89/166] 10.222.0.62 () {56 vars in 1374 bytes} [Fri May 27 08:26:24 2022] GET /identity/v3/role_assignments?user.id=f12e0800a0284df5b6aec65ab2d4e334&scope.project.id=befb09928b604b3e89c10a3f78d3aede&role.id=9ff71fb5e7b7407d8d243eaa7da0a125 => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:26:24.233142 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed1f3f8-9819-4b65-8d58-5ef41beb6be8 None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:24.330885 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fb6149-4395-4f91-99e5-5284c34f17a6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:24.332414 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fb6149-4395-4f91-99e5-5284c34f17a6 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:24.445103 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed1f3f8-9819-4b65-8d58-5ef41beb6be8 None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:24.510913 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8861d4a-eb78-4f39-8bc6-811521881022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:24.511590 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8861d4a-eb78-4f39-8bc6-811521881022 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:24.511872 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8861d4a-eb78-4f39-8bc6-811521881022 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:24.512150 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8861d4a-eb78-4f39-8bc6-811521881022 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:24.610689 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:24.625840 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 78/167] 10.222.0.62 () {58 vars in 1282 bytes} [Fri May 27 08:26:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 664 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 08:26:24.627209 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d0afb7-3be6-4c33-afc5-4826a00f3c84 None None] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:24.627502 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d0afb7-3be6-4c33-afc5-4826a00f3c84 None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:24.627929 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d0afb7-3be6-4c33-afc5-4826a00f3c84 None None] PATH_INFO: `/` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:24.629248 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 79/168] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:26:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:26:24.634685 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d0afb7-3be6-4c33-afc5-4826a00f3c84 None None] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:24.671592 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8861d4a-eb78-4f39-8bc6-811521881022 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:24.673134 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8861d4a-eb78-4f39-8bc6-811521881022 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:24.695096 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:24.807933 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d0afb7-3be6-4c33-afc5-4826a00f3c84 None None] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:24.860151 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9dade3-8b78-43b0-9d78-66f7be513cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:24.861081 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9dade3-8b78-43b0-9d78-66f7be513cd6 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:24.861371 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9dade3-8b78-43b0-9d78-66f7be513cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:24.861653 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9dade3-8b78-43b0-9d78-66f7be513cd6 None admin] PATH_INFO: `/v3/projects/befb09928b604b3e89c10a3f78d3aede` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:24.863591 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9dade3-8b78-43b0-9d78-66f7be513cd6 None admin] RBAC: Authorizing `identity:get_project(project_id=befb09928b604b3e89c10a3f78d3aede)` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:24.865324 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9dade3-8b78-43b0-9d78-66f7be513cd6 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:24.867224 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 80/169] 10.222.0.62 () {56 vars in 1186 bytes} [Fri May 27 08:26:24 2022] GET /identity/v3/projects/befb09928b604b3e89c10a3f78d3aede => generated 298 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 08:26:24.868501 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd4947b-c9a7-4de1-ba55-c9152d1b0893 None None] REQUEST_METHOD: `POST` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:24.868825 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd4947b-c9a7-4de1-ba55-c9152d1b0893 None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:24.869109 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd4947b-c9a7-4de1-ba55-c9152d1b0893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:24.900320 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.auth.core [None req-8dd4947b-c9a7-4de1-ba55-c9152d1b0893 None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:26:24.901619 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.fernet_utils [None req-8dd4947b-c9a7-4de1-ba55-c9152d1b0893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:26:25.020368 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 90/170] 10.222.0.62 () {58 vars in 1282 bytes} [Fri May 27 08:26:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 788 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 08:26:25.021725 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8861d4a-eb78-4f39-8bc6-811521881022 None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:25.083701 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 81/171] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:26:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 08:26:25.084314 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd4947b-c9a7-4de1-ba55-c9152d1b0893 None None] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:25.205164 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:25.220251 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:25.266918 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8861d4a-eb78-4f39-8bc6-811521881022 None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:25.311367 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba590f9-6312-4ff6-a436-ff1116a85d4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:25.312037 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba590f9-6312-4ff6-a436-ff1116a85d4b None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:25.312330 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba590f9-6312-4ff6-a436-ff1116a85d4b None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:25.312638 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba590f9-6312-4ff6-a436-ff1116a85d4b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:25.313497 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba590f9-6312-4ff6-a436-ff1116a85d4b None admin] RBAC: Adding query filter params (role.id=5e6f243a7201412c965e7c70249d4dc0, scope.project.id=befb09928b604b3e89c10a3f78d3aede, user.id=ca179b0a3ab4467ba61f4e713c6eb763) {{(pid=87173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:26:25.314355 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba590f9-6312-4ff6-a436-ff1116a85d4b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:25.315994 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba590f9-6312-4ff6-a436-ff1116a85d4b None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:25.322650 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 91/172] 10.222.0.62 () {56 vars in 1374 bytes} [Fri May 27 08:26:25 2022] GET /identity/v3/role_assignments?user.id=ca179b0a3ab4467ba61f4e713c6eb763&scope.project.id=befb09928b604b3e89c10a3f78d3aede&role.id=5e6f243a7201412c965e7c70249d4dc0 => generated 608 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:26:25.323494 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba590f9-6312-4ff6-a436-ff1116a85d4b None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:25.387095 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd4947b-c9a7-4de1-ba55-c9152d1b0893 None None] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:25.442283 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba590f9-6312-4ff6-a436-ff1116a85d4b None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:25.480878 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f814b4c-dfc0-45d7-b721-7c6489e54b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:25.481771 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bb35d7-9ec8-4b64-ad6a-06a86549df3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:25.482405 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f814b4c-dfc0-45d7-b721-7c6489e54b57 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:25.482595 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bb35d7-9ec8-4b64-ad6a-06a86549df3f None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:25.482861 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bb35d7-9ec8-4b64-ad6a-06a86549df3f None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:25.483143 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bb35d7-9ec8-4b64-ad6a-06a86549df3f None admin] PATH_INFO: `/v3/roles/member` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:25.483541 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f814b4c-dfc0-45d7-b721-7c6489e54b57 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:25.484009 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f814b4c-dfc0-45d7-b721-7c6489e54b57 None admin] PATH_INFO: `/v3/projects/befb09928b604b3e89c10a3f78d3aede` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:25.490153 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f814b4c-dfc0-45d7-b721-7c6489e54b57 None admin] RBAC: Authorizing `identity:get_project(project_id=befb09928b604b3e89c10a3f78d3aede)` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:25.492120 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f814b4c-dfc0-45d7-b721-7c6489e54b57 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:25.492980 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:25.494760 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 82/173] 10.222.0.62 () {56 vars in 1186 bytes} [Fri May 27 08:26:25 2022] GET /identity/v3/projects/befb09928b604b3e89c10a3f78d3aede => generated 298 bytes in 411 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:26:25.496177 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac9b00a-012a-4e75-a650-bea2f6b6dc6f None None] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:25.496570 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac9b00a-012a-4e75-a650-bea2f6b6dc6f None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:25.500968 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac9b00a-012a-4e75-a650-bea2f6b6dc6f None None] PATH_INFO: `/` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:25.501156 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bb35d7-9ec8-4b64-ad6a-06a86549df3f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 08:26:25.502693 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 83/174] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:26:25 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:26:25.509372 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application [None req-f7bb35d7-9ec8-4b64-ad6a-06a86549df3f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 08:26:25.509372 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:26:25.509372 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:26:25.509372 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:26:25.509372 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:26:25.509372 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:26:25.509372 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:26:25.509372 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:26:25.509372 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:26:25.509372 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:26:25.509372 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:26:25.509372 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:26:25.509372 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 08:26:25.509372 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 08:26:25.509372 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 08:26:25.509372 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 08:26:25.510882 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 08:26:25.510882 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 08:26:25.510882 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 08:26:25.510882 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 08:26:25.510882 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:26:25.510882 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:26:25.510882 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:26:25.510882 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:26:25.510882 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:26:25.510882 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:26:25.510882 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:26:25.510882 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application with Lock( May 27 08:26:25.510882 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:26:25.510882 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._enter() May 27 08:26:25.510882 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:26:25.510882 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:26:25.511777 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:26:25.511777 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.creator() May 27 08:26:25.511777 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:26:25.511777 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application created_value = creator( May 27 08:26:25.511777 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 08:26:25.511777 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 08:26:25.511777 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 08:26:25.511777 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 08:26:25.511777 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 08:26:25.511777 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 08:26:25.511777 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 08:26:25.511777 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application May 27 08:26:25.512498 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740689fe-2895-4e39-9323-a22bf647773a None None] REQUEST_METHOD: `POST` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:25.512498 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740689fe-2895-4e39-9323-a22bf647773a None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:25.512498 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740689fe-2895-4e39-9323-a22bf647773a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:25.512747 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 92/175] 10.222.0.62 () {56 vars in 1099 bytes} [Fri May 27 08:26:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 08:26:25.512747 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bb35d7-9ec8-4b64-ad6a-06a86549df3f None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:25.557739 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.auth.core [None req-740689fe-2895-4e39-9323-a22bf647773a None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:26:25.558991 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.fernet_utils [None req-740689fe-2895-4e39-9323-a22bf647773a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:26:25.663899 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bb35d7-9ec8-4b64-ad6a-06a86549df3f None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:25.679356 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 84/176] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:26:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 08:26:25.680057 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740689fe-2895-4e39-9323-a22bf647773a None None] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:25.717097 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:25.789407 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8320eda8-22a0-4a50-b643-6f231c9cef17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:25.790105 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8320eda8-22a0-4a50-b643-6f231c9cef17 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:25.790395 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8320eda8-22a0-4a50-b643-6f231c9cef17 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:25.790675 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8320eda8-22a0-4a50-b643-6f231c9cef17 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:25.791523 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8320eda8-22a0-4a50-b643-6f231c9cef17 None admin] RBAC: Adding query filter params (role.id=c980c64bb84b418daa012ae45a054b37, scope.project.id=befb09928b604b3e89c10a3f78d3aede, user.id=f12e0800a0284df5b6aec65ab2d4e334) {{(pid=87173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:26:25.791842 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8320eda8-22a0-4a50-b643-6f231c9cef17 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:25.793359 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8320eda8-22a0-4a50-b643-6f231c9cef17 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:25.799929 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 93/177] 10.222.0.62 () {56 vars in 1374 bytes} [Fri May 27 08:26:25 2022] GET /identity/v3/role_assignments?user.id=f12e0800a0284df5b6aec65ab2d4e334&scope.project.id=befb09928b604b3e89c10a3f78d3aede&role.id=c980c64bb84b418daa012ae45a054b37 => generated 608 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 08:26:25.800801 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8320eda8-22a0-4a50-b643-6f231c9cef17 None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:25.831516 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740689fe-2895-4e39-9323-a22bf647773a None None] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:25.906482 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c8b66f-ba71-47cb-ae4d-3a4b4dcf059c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:25.907084 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c8b66f-ba71-47cb-ae4d-3a4b4dcf059c None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:25.907368 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c8b66f-ba71-47cb-ae4d-3a4b4dcf059c None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:25.907643 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c8b66f-ba71-47cb-ae4d-3a4b4dcf059c None admin] PATH_INFO: `/v3/roles` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:25.908412 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c8b66f-ba71-47cb-ae4d-3a4b4dcf059c None admin] RBAC: Adding query filter params (name=member) {{(pid=87172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:26:25.908753 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c8b66f-ba71-47cb-ae4d-3a4b4dcf059c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:25.910187 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c8b66f-ba71-47cb-ae4d-3a4b4dcf059c None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:25.931603 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:25.932538 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 85/178] 10.222.0.62 () {56 vars in 1101 bytes} [Fri May 27 08:26:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:26:25.934044 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629725f6-f7ac-4b66-8f81-1a328d801411 None None] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:25.934811 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629725f6-f7ac-4b66-8f81-1a328d801411 None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:25.935124 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629725f6-f7ac-4b66-8f81-1a328d801411 None None] PATH_INFO: `/` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:25.940179 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 86/179] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:26:25 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:26:25.941013 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629725f6-f7ac-4b66-8f81-1a328d801411 None None] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:26.029509 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8320eda8-22a0-4a50-b643-6f231c9cef17 None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:26.079661 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f56432-bb8d-4587-8f13-0f60edba7187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:26.080334 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:26.080453 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f56432-bb8d-4587-8f13-0f60edba7187 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:26.080827 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f56432-bb8d-4587-8f13-0f60edba7187 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:26.081112 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f56432-bb8d-4587-8f13-0f60edba7187 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:26.097274 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629725f6-f7ac-4b66-8f81-1a328d801411 None None] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:26.097470 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f56432-bb8d-4587-8f13-0f60edba7187 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 08:26:26.107849 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application [None req-54f56432-bb8d-4587-8f13-0f60edba7187 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 08:26:26.107849 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:26:26.107849 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:26:26.107849 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:26:26.107849 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:26:26.107849 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:26:26.107849 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:26:26.107849 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:26:26.107849 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:26:26.107849 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:26:26.107849 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:26:26.107849 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:26:26.107849 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 08:26:26.107849 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 08:26:26.107849 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 08:26:26.107849 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 08:26:26.108822 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 08:26:26.108822 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 08:26:26.108822 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 08:26:26.108822 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 08:26:26.108822 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:26:26.108822 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:26:26.108822 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:26:26.108822 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:26:26.108822 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:26:26.108822 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:26:26.108822 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:26:26.108822 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application with Lock( May 27 08:26:26.108822 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:26:26.108822 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._enter() May 27 08:26:26.108822 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:26:26.108822 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:26:26.109616 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:26:26.109616 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.creator() May 27 08:26:26.109616 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:26:26.109616 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application created_value = creator( May 27 08:26:26.109616 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 08:26:26.109616 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 08:26:26.109616 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 08:26:26.109616 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 08:26:26.109616 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 08:26:26.109616 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 08:26:26.109616 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 08:26:26.109616 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application May 27 08:26:26.109616 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 94/180] 10.222.0.62 () {56 vars in 1096 bytes} [Fri May 27 08:26:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 08:26:26.110782 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcb8578-2f07-4e08-9dfe-a5180b70e1a3 None None] REQUEST_METHOD: `POST` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:26.110782 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcb8578-2f07-4e08-9dfe-a5180b70e1a3 None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:26.110912 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcb8578-2f07-4e08-9dfe-a5180b70e1a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:26.139477 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.auth.core [None req-7bcb8578-2f07-4e08-9dfe-a5180b70e1a3 None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:26:26.139477 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.fernet_utils [None req-7bcb8578-2f07-4e08-9dfe-a5180b70e1a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:26:26.150899 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1311fab-3e02-4f60-813c-e8e13dc108eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:26.152932 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1311fab-3e02-4f60-813c-e8e13dc108eb None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:26.152932 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1311fab-3e02-4f60-813c-e8e13dc108eb None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:26.152932 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1311fab-3e02-4f60-813c-e8e13dc108eb None admin] PATH_INFO: `/v3/users/f12e0800a0284df5b6aec65ab2d4e334` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:26.155276 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1311fab-3e02-4f60-813c-e8e13dc108eb None admin] RBAC: Authorizing `identity:get_user(user_id=f12e0800a0284df5b6aec65ab2d4e334)` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:26.156975 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1311fab-3e02-4f60-813c-e8e13dc108eb None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:26.158893 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 87/181] 10.222.0.62 () {56 vars in 1177 bytes} [Fri May 27 08:26:25 2022] GET /identity/v3/users/f12e0800a0284df5b6aec65ab2d4e334 => generated 275 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:26:26.160286 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e308c0-5799-43c9-acb0-18e66b69b9c0 None None] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:26.160766 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e308c0-5799-43c9-acb0-18e66b69b9c0 None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:26.161164 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e308c0-5799-43c9-acb0-18e66b69b9c0 None None] PATH_INFO: `/` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:26.163324 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 88/182] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:26:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:26:26.168207 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e308c0-5799-43c9-acb0-18e66b69b9c0 None None] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:26.232868 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 95/183] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:26:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 08:26:26.234037 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcb8578-2f07-4e08-9dfe-a5180b70e1a3 None None] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:26.301632 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e308c0-5799-43c9-acb0-18e66b69b9c0 None None] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:26.317702 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:26.340273 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26072554-75af-4d97-9b33-db1bf9e1d948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:26.341031 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26072554-75af-4d97-9b33-db1bf9e1d948 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:26.341366 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26072554-75af-4d97-9b33-db1bf9e1d948 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:26.341682 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26072554-75af-4d97-9b33-db1bf9e1d948 None admin] PATH_INFO: `/v3/roles` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:26.342482 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26072554-75af-4d97-9b33-db1bf9e1d948 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:26:26.342829 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26072554-75af-4d97-9b33-db1bf9e1d948 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:26.344253 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26072554-75af-4d97-9b33-db1bf9e1d948 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:26.359269 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 89/184] 10.222.0.62 () {56 vars in 1099 bytes} [Fri May 27 08:26:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:26:26.359269 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473c5aa7-e4af-40d1-ae8a-cda57272ce54 None None] REQUEST_METHOD: `POST` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:26.359269 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473c5aa7-e4af-40d1-ae8a-cda57272ce54 None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:26.359269 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473c5aa7-e4af-40d1-ae8a-cda57272ce54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:26.374320 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.auth.core [None req-473c5aa7-e4af-40d1-ae8a-cda57272ce54 None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:26:26.375170 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcb8578-2f07-4e08-9dfe-a5180b70e1a3 None None] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:26.375530 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.fernet_utils [None req-473c5aa7-e4af-40d1-ae8a-cda57272ce54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:26:26.392484 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:26.417702 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4044324c-97c3-4a40-911f-484793a572ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:26.418301 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4044324c-97c3-4a40-911f-484793a572ea None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:26.418586 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4044324c-97c3-4a40-911f-484793a572ea None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:26.418862 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4044324c-97c3-4a40-911f-484793a572ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:26.453136 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 90/185] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:26:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 08:26:26.454032 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473c5aa7-e4af-40d1-ae8a-cda57272ce54 None None] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:26.497317 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4044324c-97c3-4a40-911f-484793a572ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:26.498710 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4044324c-97c3-4a40-911f-484793a572ea None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:26.554394 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:26.564890 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473c5aa7-e4af-40d1-ae8a-cda57272ce54 None None] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:26.600827 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 96/186] 10.222.0.62 () {58 vars in 1282 bytes} [Fri May 27 08:26:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 08:26:26.601117 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe021395-f791-483a-86b4-c963cea9bc3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:26.601770 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4044324c-97c3-4a40-911f-484793a572ea None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:26.601992 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe021395-f791-483a-86b4-c963cea9bc3b None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:26.602253 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe021395-f791-483a-86b4-c963cea9bc3b None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:26.602566 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe021395-f791-483a-86b4-c963cea9bc3b None admin] PATH_INFO: `/v3/domains/default` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:26.603817 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe021395-f791-483a-86b4-c963cea9bc3b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:26.605332 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe021395-f791-483a-86b4-c963cea9bc3b None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:26.607017 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 91/187] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 08:26:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:26:26.608213 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a193ccd5-97ba-479a-bce2-17c052b1d7f5 None None] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:26.609556 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a193ccd5-97ba-479a-bce2-17c052b1d7f5 None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:26.609556 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a193ccd5-97ba-479a-bce2-17c052b1d7f5 None None] PATH_INFO: `/` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:26.610276 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 92/188] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:26:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:26:26.610875 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a193ccd5-97ba-479a-bce2-17c052b1d7f5 None None] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:26.631412 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:26.716809 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4044324c-97c3-4a40-911f-484793a572ea None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:26.717689 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a193ccd5-97ba-479a-bce2-17c052b1d7f5 None None] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:26.750899 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62497984-2327-4914-8aff-05f2ec0095e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:26.751671 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cc497b-34db-4ba8-a93c-6a0b6f11cd81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:26.751794 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62497984-2327-4914-8aff-05f2ec0095e1 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:26.752042 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62497984-2327-4914-8aff-05f2ec0095e1 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:26.752317 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62497984-2327-4914-8aff-05f2ec0095e1 None admin] PATH_INFO: `/v3/users/1d53a0c91b194cbca182f2e226522ad9` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:26.752476 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cc497b-34db-4ba8-a93c-6a0b6f11cd81 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:26.752800 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cc497b-34db-4ba8-a93c-6a0b6f11cd81 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:26.753083 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cc497b-34db-4ba8-a93c-6a0b6f11cd81 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:26.764052 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cc497b-34db-4ba8-a93c-6a0b6f11cd81 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 08:26:26.766317 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62497984-2327-4914-8aff-05f2ec0095e1 None admin] RBAC: Authorizing `identity:get_user(user_id=1d53a0c91b194cbca182f2e226522ad9)` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:26.767790 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62497984-2327-4914-8aff-05f2ec0095e1 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:26.769513 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 97/189] 10.222.0.62 () {56 vars in 1177 bytes} [Fri May 27 08:26:26 2022] GET /identity/v3/users/1d53a0c91b194cbca182f2e226522ad9 => generated 283 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:26:26.770848 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62497984-2327-4914-8aff-05f2ec0095e1 None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:26.773275 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application [None req-d9cc497b-34db-4ba8-a93c-6a0b6f11cd81 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 08:26:26.773275 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:26:26.773275 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:26:26.773275 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:26:26.773275 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:26:26.773275 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:26:26.773275 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:26:26.773275 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:26:26.773275 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:26:26.773275 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:26:26.773275 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:26:26.773275 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:26:26.773275 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 08:26:26.773275 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 08:26:26.773275 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 08:26:26.773275 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 08:26:26.774146 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 08:26:26.774146 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 08:26:26.774146 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 08:26:26.774146 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 08:26:26.774146 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:26:26.774146 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:26:26.774146 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:26:26.774146 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:26:26.774146 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:26:26.774146 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:26:26.774146 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:26:26.774146 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application with Lock( May 27 08:26:26.774146 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:26:26.774146 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._enter() May 27 08:26:26.774146 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:26:26.774146 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:26:26.774938 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:26:26.774938 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.creator() May 27 08:26:26.774938 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:26:26.774938 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application created_value = creator( May 27 08:26:26.774938 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 08:26:26.774938 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 08:26:26.774938 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 08:26:26.774938 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 08:26:26.774938 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 08:26:26.774938 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 08:26:26.774938 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 08:26:26.774938 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application May 27 08:26:26.774938 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 93/190] 10.222.0.62 () {56 vars in 1114 bytes} [Fri May 27 08:26:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 08:26:26.775607 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cc497b-34db-4ba8-a93c-6a0b6f11cd81 None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:26.788718 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:26.856676 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:26.878429 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62497984-2327-4914-8aff-05f2ec0095e1 None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:26.882429 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cc497b-34db-4ba8-a93c-6a0b6f11cd81 None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:26.913987 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aa2b2d-e406-43bb-a64e-23be4969c8fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:26.914842 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aa2b2d-e406-43bb-a64e-23be4969c8fb None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:26.915126 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aa2b2d-e406-43bb-a64e-23be4969c8fb None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:26.915412 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aa2b2d-e406-43bb-a64e-23be4969c8fb None admin] PATH_INFO: `/v3/projects/4698f614e26e44578837f8500ed63ba9` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:26.916598 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aa2b2d-e406-43bb-a64e-23be4969c8fb None admin] RBAC: Authorizing `identity:get_project(project_id=4698f614e26e44578837f8500ed63ba9)` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:26.917245 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7507a4-c8d4-4f5f-a657-94fb02998505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:26.917918 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7507a4-c8d4-4f5f-a657-94fb02998505 None admin] REQUEST_METHOD: `POST` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:26.918100 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aa2b2d-e406-43bb-a64e-23be4969c8fb None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:26.918198 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7507a4-c8d4-4f5f-a657-94fb02998505 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:26.918461 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7507a4-c8d4-4f5f-a657-94fb02998505 None admin] PATH_INFO: `/v3/users` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:26.919170 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7507a4-c8d4-4f5f-a657-94fb02998505 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:26.919810 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 98/191] 10.222.0.62 () {56 vars in 1186 bytes} [Fri May 27 08:26:26 2022] GET /identity/v3/projects/4698f614e26e44578837f8500ed63ba9 => generated 312 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:26:26.920622 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7507a4-c8d4-4f5f-a657-94fb02998505 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:26.920973 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda8e8a2-5d09-4967-b22d-17a929da5363 None None] REQUEST_METHOD: `POST` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:26.921257 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda8e8a2-5d09-4967-b22d-17a929da5363 None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:26.921533 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda8e8a2-5d09-4967-b22d-17a929da5363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:26.938354 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.auth.core [None req-cda8e8a2-5d09-4967-b22d-17a929da5363 None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:26:26.939578 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.fernet_utils [None req-cda8e8a2-5d09-4967-b22d-17a929da5363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:26:26.940144 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 94/192] 10.222.0.62 () {60 vars in 1132 bytes} [Fri May 27 08:26:26 2022] POST /identity/v3/users => generated 297 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 08:26:26.945636 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7507a4-c8d4-4f5f-a657-94fb02998505 None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:27.032708 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 99/193] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:26:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 08:26:27.032708 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda8e8a2-5d09-4967-b22d-17a929da5363 None None] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:27.047397 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:27.086950 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7507a4-c8d4-4f5f-a657-94fb02998505 None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:27.124622 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e777f4-86cc-45f9-b01e-e26ee19abc2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:27.125895 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e777f4-86cc-45f9-b01e-e26ee19abc2e None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:27.125895 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e777f4-86cc-45f9-b01e-e26ee19abc2e None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:27.125895 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e777f4-86cc-45f9-b01e-e26ee19abc2e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:27.129093 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:27.159402 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda8e8a2-5d09-4967-b22d-17a929da5363 None None] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:27.199617 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d42519-aa9a-4e57-8c34-f1ad41c4dea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:27.200303 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d42519-aa9a-4e57-8c34-f1ad41c4dea0 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:27.200618 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d42519-aa9a-4e57-8c34-f1ad41c4dea0 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:27.200910 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d42519-aa9a-4e57-8c34-f1ad41c4dea0 None admin] PATH_INFO: `/v3/roles` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:27.201665 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d42519-aa9a-4e57-8c34-f1ad41c4dea0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:26:27.201975 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d42519-aa9a-4e57-8c34-f1ad41c4dea0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:27.203414 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d42519-aa9a-4e57-8c34-f1ad41c4dea0 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:27.211387 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e777f4-86cc-45f9-b01e-e26ee19abc2e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:27.213296 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e777f4-86cc-45f9-b01e-e26ee19abc2e None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:27.213841 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 100/194] 10.222.0.62 () {56 vars in 1111 bytes} [Fri May 27 08:26:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:26:27.214702 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d42519-aa9a-4e57-8c34-f1ad41c4dea0 None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:27.328285 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:27.354643 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 95/195] 10.222.0.62 () {58 vars in 1282 bytes} [Fri May 27 08:26:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 08:26:27.355384 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e777f4-86cc-45f9-b01e-e26ee19abc2e None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:27.362332 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d42519-aa9a-4e57-8c34-f1ad41c4dea0 None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:27.407570 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af33487-ebb3-4641-a8b6-2e72cb894f3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:27.408248 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af33487-ebb3-4641-a8b6-2e72cb894f3a None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:27.408534 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af33487-ebb3-4641-a8b6-2e72cb894f3a None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:27.408975 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af33487-ebb3-4641-a8b6-2e72cb894f3a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:27.409638 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:27.412665 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af33487-ebb3-4641-a8b6-2e72cb894f3a None admin] RBAC: Adding query filter params (role.id=c980c64bb84b418daa012ae45a054b37, scope.project.id=4698f614e26e44578837f8500ed63ba9, user.id=f12e0800a0284df5b6aec65ab2d4e334) {{(pid=87173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:26:27.413060 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af33487-ebb3-4641-a8b6-2e72cb894f3a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:27.414600 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af33487-ebb3-4641-a8b6-2e72cb894f3a None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:27.423088 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 101/196] 10.222.0.62 () {56 vars in 1374 bytes} [Fri May 27 08:26:27 2022] GET /identity/v3/role_assignments?user.id=f12e0800a0284df5b6aec65ab2d4e334&scope.project.id=4698f614e26e44578837f8500ed63ba9&role.id=c980c64bb84b418daa012ae45a054b37 => generated 608 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:26:27.425109 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af33487-ebb3-4641-a8b6-2e72cb894f3a None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:27.551677 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e777f4-86cc-45f9-b01e-e26ee19abc2e None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:27.622052 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af33487-ebb3-4641-a8b6-2e72cb894f3a None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:27.638699 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf4c042-391b-4624-84a0-0d61e5f2fe1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:27.638699 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf4c042-391b-4624-84a0-0d61e5f2fe1f None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:27.638699 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf4c042-391b-4624-84a0-0d61e5f2fe1f None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:27.638699 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf4c042-391b-4624-84a0-0d61e5f2fe1f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:27.664021 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf4c042-391b-4624-84a0-0d61e5f2fe1f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 08:26:27.669533 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f4eed1-499b-4c96-bd4a-27989d9ced9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:27.670540 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f4eed1-499b-4c96-bd4a-27989d9ced9d None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:27.670931 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f4eed1-499b-4c96-bd4a-27989d9ced9d None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:27.671310 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f4eed1-499b-4c96-bd4a-27989d9ced9d None admin] PATH_INFO: `/v3/users/1d53a0c91b194cbca182f2e226522ad9` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:27.672716 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f4eed1-499b-4c96-bd4a-27989d9ced9d None admin] RBAC: Authorizing `identity:get_user(user_id=1d53a0c91b194cbca182f2e226522ad9)` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:27.673595 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application [None req-0bf4c042-391b-4624-84a0-0d61e5f2fe1f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 27 08:26:27.673595 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:26:27.673595 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:26:27.673595 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:26:27.673595 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:26:27.673595 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:26:27.673595 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:26:27.673595 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:26:27.673595 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:26:27.673595 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:26:27.673595 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:26:27.673595 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:26:27.673595 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 08:26:27.673595 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 08:26:27.673595 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 08:26:27.673595 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 08:26:27.674473 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 08:26:27.674473 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 08:26:27.674473 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 08:26:27.674473 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 08:26:27.674473 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:26:27.674473 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:26:27.674473 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:26:27.674473 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:26:27.674473 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:26:27.674473 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:26:27.674473 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:26:27.674473 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application with Lock( May 27 08:26:27.674473 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:26:27.674473 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._enter() May 27 08:26:27.674473 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:26:27.674473 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:26:27.675425 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:26:27.675425 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.creator() May 27 08:26:27.675425 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:26:27.675425 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application created_value = creator( May 27 08:26:27.675425 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 08:26:27.675425 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 08:26:27.675425 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 08:26:27.675425 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 08:26:27.675425 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 08:26:27.675425 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 08:26:27.675425 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 27 08:26:27.675425 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application May 27 08:26:27.676304 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f4eed1-499b-4c96-bd4a-27989d9ced9d None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:27.676375 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 96/197] 10.222.0.62 () {56 vars in 1099 bytes} [Fri May 27 08:26:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 08:26:27.676375 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf4c042-391b-4624-84a0-0d61e5f2fe1f None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:27.677023 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 102/198] 10.222.0.62 () {56 vars in 1177 bytes} [Fri May 27 08:26:27 2022] GET /identity/v3/users/1d53a0c91b194cbca182f2e226522ad9 => generated 283 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:26:27.682075 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f4eed1-499b-4c96-bd4a-27989d9ced9d None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:27.686160 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:27.809146 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:27.812499 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f4eed1-499b-4c96-bd4a-27989d9ced9d None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:27.817377 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf4c042-391b-4624-84a0-0d61e5f2fe1f None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:27.861821 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0579b0f1-4426-4115-bece-003dce89609d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:27.862853 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0579b0f1-4426-4115-bece-003dce89609d None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:27.863236 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0579b0f1-4426-4115-bece-003dce89609d None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:27.863663 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0579b0f1-4426-4115-bece-003dce89609d None admin] PATH_INFO: `/v3/projects/7086655a913e49b899fae73f13ec6c42` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:27.863967 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbd3f80-4c19-416c-ab5e-9b94b35184e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:27.864900 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbd3f80-4c19-416c-ab5e-9b94b35184e0 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:27.865372 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbd3f80-4c19-416c-ab5e-9b94b35184e0 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:27.865845 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbd3f80-4c19-416c-ab5e-9b94b35184e0 None admin] PATH_INFO: `/v3/roles` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:27.866797 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbd3f80-4c19-416c-ab5e-9b94b35184e0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:26:27.867110 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbd3f80-4c19-416c-ab5e-9b94b35184e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:27.868539 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbd3f80-4c19-416c-ab5e-9b94b35184e0 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:27.872990 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0579b0f1-4426-4115-bece-003dce89609d None admin] RBAC: Authorizing `identity:get_project(project_id=7086655a913e49b899fae73f13ec6c42)` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:27.872990 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0579b0f1-4426-4115-bece-003dce89609d None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:27.873879 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 97/199] 10.222.0.62 () {56 vars in 1186 bytes} [Fri May 27 08:26:27 2022] GET /identity/v3/projects/7086655a913e49b899fae73f13ec6c42 => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:26:27.874602 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0579b0f1-4426-4115-bece-003dce89609d None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:27.883264 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 103/200] 10.222.0.62 () {56 vars in 1101 bytes} [Fri May 27 08:26:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:26:27.884423 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbd3f80-4c19-416c-ab5e-9b94b35184e0 None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:27.963596 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:27.994601 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0579b0f1-4426-4115-bece-003dce89609d None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:28.014754 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbd3f80-4c19-416c-ab5e-9b94b35184e0 None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:28.038036 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb6893a-892f-4149-b725-bddb62739bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:28.038689 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb6893a-892f-4149-b725-bddb62739bcf None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:28.038973 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb6893a-892f-4149-b725-bddb62739bcf None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:28.039249 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb6893a-892f-4149-b725-bddb62739bcf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:28.056449 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc9a9f4-ada9-4784-9925-b42cf83993e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:28.057936 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc9a9f4-ada9-4784-9925-b42cf83993e8 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:28.058448 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc9a9f4-ada9-4784-9925-b42cf83993e8 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:28.059041 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc9a9f4-ada9-4784-9925-b42cf83993e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:28.060132 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc9a9f4-ada9-4784-9925-b42cf83993e8 None admin] RBAC: Adding query filter params (role.id=5e6f243a7201412c965e7c70249d4dc0, scope.project.id=7086655a913e49b899fae73f13ec6c42, user.id=1d53a0c91b194cbca182f2e226522ad9) {{(pid=87173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:26:28.060671 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc9a9f4-ada9-4784-9925-b42cf83993e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:28.062644 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc9a9f4-ada9-4784-9925-b42cf83993e8 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:28.069633 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 104/201] 10.222.0.62 () {56 vars in 1374 bytes} [Fri May 27 08:26:27 2022] GET /identity/v3/role_assignments?user.id=1d53a0c91b194cbca182f2e226522ad9&scope.project.id=7086655a913e49b899fae73f13ec6c42&role.id=5e6f243a7201412c965e7c70249d4dc0 => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:26:28.070781 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc9a9f4-ada9-4784-9925-b42cf83993e8 None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:28.090673 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:28.170085 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb6893a-892f-4149-b725-bddb62739bcf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:28.171965 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb6893a-892f-4149-b725-bddb62739bcf None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:28.282290 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc9a9f4-ada9-4784-9925-b42cf83993e8 None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:28.331938 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:28.347656 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670e4e6d-e4e2-4f47-9560-9d8662a62943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:28.348688 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670e4e6d-e4e2-4f47-9560-9d8662a62943 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:28.348912 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670e4e6d-e4e2-4f47-9560-9d8662a62943 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:28.349184 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670e4e6d-e4e2-4f47-9560-9d8662a62943 None admin] PATH_INFO: `/v3/users/93f46d0892534f4a84f618904b9f17fb` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:28.351355 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670e4e6d-e4e2-4f47-9560-9d8662a62943 None admin] RBAC: Authorizing `identity:get_user(user_id=93f46d0892534f4a84f618904b9f17fb)` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:28.353365 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670e4e6d-e4e2-4f47-9560-9d8662a62943 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:28.355511 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 105/202] 10.222.0.62 () {56 vars in 1177 bytes} [Fri May 27 08:26:28 2022] GET /identity/v3/users/93f46d0892534f4a84f618904b9f17fb => generated 289 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:26:28.362012 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670e4e6d-e4e2-4f47-9560-9d8662a62943 None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:28.367642 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 98/203] 10.222.0.62 () {58 vars in 1282 bytes} [Fri May 27 08:26:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 08:26:28.380140 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb6893a-892f-4149-b725-bddb62739bcf None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:28.507885 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:28.566372 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670e4e6d-e4e2-4f47-9560-9d8662a62943 None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:28.584686 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb6893a-892f-4149-b725-bddb62739bcf None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:28.642835 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ec79de-717e-4765-9fd9-36a256b40c36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:28.643727 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ec79de-717e-4765-9fd9-36a256b40c36 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:28.644013 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ec79de-717e-4765-9fd9-36a256b40c36 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:28.644290 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ec79de-717e-4765-9fd9-36a256b40c36 None admin] PATH_INFO: `/v3/projects/7086655a913e49b899fae73f13ec6c42` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:28.645704 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ec79de-717e-4765-9fd9-36a256b40c36 None admin] RBAC: Authorizing `identity:get_project(project_id=7086655a913e49b899fae73f13ec6c42)` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:28.647379 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ec79de-717e-4765-9fd9-36a256b40c36 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:28.649505 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 99/204] 10.222.0.62 () {56 vars in 1186 bytes} [Fri May 27 08:26:28 2022] GET /identity/v3/projects/7086655a913e49b899fae73f13ec6c42 => generated 302 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:26:28.654299 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4274ceb3-a70b-41d1-907e-4656134036a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:28.655579 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ec79de-717e-4765-9fd9-36a256b40c36 None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:28.656491 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4274ceb3-a70b-41d1-907e-4656134036a2 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:28.656804 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4274ceb3-a70b-41d1-907e-4656134036a2 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:28.657080 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4274ceb3-a70b-41d1-907e-4656134036a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:28.795733 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:28.806762 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4274ceb3-a70b-41d1-907e-4656134036a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:28.808433 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4274ceb3-a70b-41d1-907e-4656134036a2 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:28.821772 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ec79de-717e-4765-9fd9-36a256b40c36 None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:28.862032 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:28.873532 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7af903-e2eb-4d34-952c-91575409f280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:28.874193 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7af903-e2eb-4d34-952c-91575409f280 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:28.874477 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7af903-e2eb-4d34-952c-91575409f280 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:28.874758 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7af903-e2eb-4d34-952c-91575409f280 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:28.875605 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7af903-e2eb-4d34-952c-91575409f280 None admin] RBAC: Adding query filter params (role.id=9ff71fb5e7b7407d8d243eaa7da0a125, scope.project.id=7086655a913e49b899fae73f13ec6c42, user.id=1d53a0c91b194cbca182f2e226522ad9) {{(pid=87172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:26:28.875915 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7af903-e2eb-4d34-952c-91575409f280 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:28.877387 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7af903-e2eb-4d34-952c-91575409f280 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:28.887542 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 100/205] 10.222.0.62 () {56 vars in 1374 bytes} [Fri May 27 08:26:28 2022] GET /identity/v3/role_assignments?user.id=1d53a0c91b194cbca182f2e226522ad9&scope.project.id=7086655a913e49b899fae73f13ec6c42&role.id=9ff71fb5e7b7407d8d243eaa7da0a125 => generated 259 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:26:28.953722 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 106/206] 10.222.0.62 () {58 vars in 1282 bytes} [Fri May 27 08:26:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 592 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 08:26:28.959883 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7af903-e2eb-4d34-952c-91575409f280 None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:29.076127 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7af903-e2eb-4d34-952c-91575409f280 None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:29.117254 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4313461-185f-4631-b192-8eb4ecd6e611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:29.118518 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4313461-185f-4631-b192-8eb4ecd6e611 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:29.118800 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4313461-185f-4631-b192-8eb4ecd6e611 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:29.119076 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4313461-185f-4631-b192-8eb4ecd6e611 None admin] PATH_INFO: `/v3/projects/befb09928b604b3e89c10a3f78d3aede` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:29.120372 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4313461-185f-4631-b192-8eb4ecd6e611 None admin] RBAC: Authorizing `identity:get_project(project_id=befb09928b604b3e89c10a3f78d3aede)` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:29.122145 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4313461-185f-4631-b192-8eb4ecd6e611 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:29.124202 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 101/207] 10.222.0.62 () {56 vars in 1186 bytes} [Fri May 27 08:26:28 2022] GET /identity/v3/projects/befb09928b604b3e89c10a3f78d3aede => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:26:29.133904 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4274ceb3-a70b-41d1-907e-4656134036a2 None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:29.257097 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:29.261176 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4274ceb3-a70b-41d1-907e-4656134036a2 None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:29.298706 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af68b10d-df8b-407f-8f88-aa93fb7fa969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:29.299370 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af68b10d-df8b-407f-8f88-aa93fb7fa969 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:29.299654 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af68b10d-df8b-407f-8f88-aa93fb7fa969 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:29.299933 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af68b10d-df8b-407f-8f88-aa93fb7fa969 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:29.300815 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af68b10d-df8b-407f-8f88-aa93fb7fa969 None admin] RBAC: Adding query filter params (role.id=279cf625eaed4bac893add184f558fd1, scope.project.id=befb09928b604b3e89c10a3f78d3aede, user.id=93f46d0892534f4a84f618904b9f17fb) {{(pid=87173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:26:29.301545 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af68b10d-df8b-407f-8f88-aa93fb7fa969 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:29.303038 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af68b10d-df8b-407f-8f88-aa93fb7fa969 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:29.312926 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 107/208] 10.222.0.62 () {56 vars in 1374 bytes} [Fri May 27 08:26:29 2022] GET /identity/v3/role_assignments?user.id=93f46d0892534f4a84f618904b9f17fb&scope.project.id=befb09928b604b3e89c10a3f78d3aede&role.id=279cf625eaed4bac893add184f558fd1 => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:26:29.600050 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d833c6-c5b9-4859-a878-f58c43be3017 None None] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:29.600407 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d833c6-c5b9-4859-a878-f58c43be3017 None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:29.600638 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d833c6-c5b9-4859-a878-f58c43be3017 None None] PATH_INFO: `/` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:29.602291 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 102/209] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:26:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:26:29.607766 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7b62f4-4ed1-46ba-b959-b9c5d6ee7303 None None] REQUEST_METHOD: `POST` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:29.608069 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7b62f4-4ed1-46ba-b959-b9c5d6ee7303 None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:29.608338 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7b62f4-4ed1-46ba-b959-b9c5d6ee7303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:29.629473 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.auth.core [None req-db7b62f4-4ed1-46ba-b959-b9c5d6ee7303 None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:26:29.630684 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.fernet_utils [None req-db7b62f4-4ed1-46ba-b959-b9c5d6ee7303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:26:29.710598 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 108/210] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:26:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 08:26:29.740023 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d833c6-c5b9-4859-a878-f58c43be3017 None None] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:29.811626 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:29.861326 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d833c6-c5b9-4859-a878-f58c43be3017 None None] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:29.905462 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1fcddb-0bea-457c-9a0f-e4686f8b2069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:29.906274 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1fcddb-0bea-457c-9a0f-e4686f8b2069 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:29.906557 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1fcddb-0bea-457c-9a0f-e4686f8b2069 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:29.906839 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1fcddb-0bea-457c-9a0f-e4686f8b2069 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:29.921735 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1fcddb-0bea-457c-9a0f-e4686f8b2069 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 08:26:29.929624 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application [None req-cd1fcddb-0bea-457c-9a0f-e4686f8b2069 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 08:26:29.929624 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:26:29.929624 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:26:29.929624 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:26:29.929624 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:26:29.929624 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:26:29.929624 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:26:29.929624 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:26:29.929624 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:26:29.929624 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:26:29.929624 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:26:29.929624 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:26:29.929624 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 08:26:29.929624 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 08:26:29.929624 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 08:26:29.929624 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 08:26:29.930566 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 08:26:29.930566 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 08:26:29.930566 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 08:26:29.930566 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 08:26:29.930566 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:26:29.930566 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:26:29.930566 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:26:29.930566 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:26:29.930566 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:26:29.930566 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:26:29.930566 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:26:29.930566 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application with Lock( May 27 08:26:29.930566 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:26:29.930566 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._enter() May 27 08:26:29.930566 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:26:29.930566 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:26:29.931379 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:26:29.931379 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.creator() May 27 08:26:29.931379 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:26:29.931379 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application created_value = creator( May 27 08:26:29.931379 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 08:26:29.931379 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 08:26:29.931379 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 08:26:29.931379 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 08:26:29.931379 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 08:26:29.931379 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 08:26:29.931379 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 08:26:29.931379 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application May 27 08:26:29.931379 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 103/211] 10.222.0.62 () {56 vars in 1099 bytes} [Fri May 27 08:26:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 08:26:29.937217 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7b62f4-4ed1-46ba-b959-b9c5d6ee7303 None None] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:30.048372 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:30.059033 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7b62f4-4ed1-46ba-b959-b9c5d6ee7303 None None] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:30.095927 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8067641-7db0-4429-8f09-aa7c0b306ae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:30.096719 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8067641-7db0-4429-8f09-aa7c0b306ae1 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:30.097097 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8067641-7db0-4429-8f09-aa7c0b306ae1 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:30.097377 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8067641-7db0-4429-8f09-aa7c0b306ae1 None admin] PATH_INFO: `/v3/roles` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:30.098274 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8067641-7db0-4429-8f09-aa7c0b306ae1 None admin] RBAC: Adding query filter params (name=member) {{(pid=87173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:26:30.098578 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8067641-7db0-4429-8f09-aa7c0b306ae1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:30.099988 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8067641-7db0-4429-8f09-aa7c0b306ae1 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:30.108947 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 109/212] 10.222.0.62 () {56 vars in 1101 bytes} [Fri May 27 08:26:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:26:30.114708 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1fcddb-0bea-457c-9a0f-e4686f8b2069 None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:30.153544 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56dad55-0240-4746-86a9-0953e53b87df None None] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:30.154171 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56dad55-0240-4746-86a9-0953e53b87df None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:30.154171 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56dad55-0240-4746-86a9-0953e53b87df None None] PATH_INFO: `/` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:30.155462 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 110/213] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:26:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:26:30.161617 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967516da-f790-4167-b5a0-fddf286b5988 None None] REQUEST_METHOD: `POST` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:30.162236 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967516da-f790-4167-b5a0-fddf286b5988 None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:30.162519 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967516da-f790-4167-b5a0-fddf286b5988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:30.180203 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.auth.core [None req-967516da-f790-4167-b5a0-fddf286b5988 None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:26:30.181631 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.fernet_utils [None req-967516da-f790-4167-b5a0-fddf286b5988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:26:30.221148 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1fcddb-0bea-457c-9a0f-e4686f8b2069 None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:30.245943 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:30.258486 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 111/214] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:26:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 08:26:30.263070 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b688fbdf-e05a-4e2a-af58-99a13db671c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:30.263070 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b688fbdf-e05a-4e2a-af58-99a13db671c6 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:30.263070 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b688fbdf-e05a-4e2a-af58-99a13db671c6 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:30.263070 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b688fbdf-e05a-4e2a-af58-99a13db671c6 None admin] PATH_INFO: `/v3/users/a488d5a3047046b18d9aecffcf353431` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:30.277626 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b688fbdf-e05a-4e2a-af58-99a13db671c6 None admin] RBAC: Authorizing `identity:get_user(user_id=a488d5a3047046b18d9aecffcf353431)` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:30.279104 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b688fbdf-e05a-4e2a-af58-99a13db671c6 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:30.281166 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 104/215] 10.222.0.62 () {56 vars in 1177 bytes} [Fri May 27 08:26:30 2022] GET /identity/v3/users/a488d5a3047046b18d9aecffcf353431 => generated 297 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:26:30.287336 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967516da-f790-4167-b5a0-fddf286b5988 None None] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:30.293080 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b688fbdf-e05a-4e2a-af58-99a13db671c6 None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:30.381315 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:30.398158 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b688fbdf-e05a-4e2a-af58-99a13db671c6 None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:30.402737 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967516da-f790-4167-b5a0-fddf286b5988 None None] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:30.436042 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66978aab-c265-4d59-9a79-8bfe65cfa96e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:30.437051 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66978aab-c265-4d59-9a79-8bfe65cfa96e None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:30.437162 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66978aab-c265-4d59-9a79-8bfe65cfa96e None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:30.437413 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66978aab-c265-4d59-9a79-8bfe65cfa96e None admin] PATH_INFO: `/v3/domains/default` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:30.438593 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66978aab-c265-4d59-9a79-8bfe65cfa96e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:30.440049 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66978aab-c265-4d59-9a79-8bfe65cfa96e None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:30.442604 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 105/216] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 08:26:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:26:30.448150 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66978aab-c265-4d59-9a79-8bfe65cfa96e None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:30.455925 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f2cdbb-83a0-4459-8e8d-efda857b159f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:30.456851 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f2cdbb-83a0-4459-8e8d-efda857b159f None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:30.457934 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f2cdbb-83a0-4459-8e8d-efda857b159f None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:30.458824 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f2cdbb-83a0-4459-8e8d-efda857b159f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:30.509073 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:30.538303 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f2cdbb-83a0-4459-8e8d-efda857b159f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:30.540141 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f2cdbb-83a0-4459-8e8d-efda857b159f None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:30.568567 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66978aab-c265-4d59-9a79-8bfe65cfa96e None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:30.606256 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37354f62-93a0-4726-860d-46667a9693e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:30.606909 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37354f62-93a0-4726-860d-46667a9693e8 None admin] REQUEST_METHOD: `POST` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:30.607194 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37354f62-93a0-4726-860d-46667a9693e8 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:30.607470 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37354f62-93a0-4726-860d-46667a9693e8 None admin] PATH_INFO: `/v3/users` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:30.608203 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37354f62-93a0-4726-860d-46667a9693e8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:30.609801 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37354f62-93a0-4726-860d-46667a9693e8 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:30.634510 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 106/217] 10.222.0.62 () {60 vars in 1132 bytes} [Fri May 27 08:26:30 2022] POST /identity/v3/users => generated 297 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 08:26:30.643847 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:30.679260 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 112/218] 10.222.0.62 () {58 vars in 1282 bytes} [Fri May 27 08:26:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 27 08:26:30.685366 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37354f62-93a0-4726-860d-46667a9693e8 None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:30.719642 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b133e52e-1906-491f-ab8b-034f4472724c None None] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:30.719984 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b133e52e-1906-491f-ab8b-034f4472724c None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:30.720269 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b133e52e-1906-491f-ab8b-034f4472724c None None] PATH_INFO: `/` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:30.722095 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 113/219] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:26:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:26:30.729224 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73053a0a-5d57-4c74-847f-d151b4440db2 None None] REQUEST_METHOD: `POST` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:30.729889 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73053a0a-5d57-4c74-847f-d151b4440db2 None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:30.730174 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73053a0a-5d57-4c74-847f-d151b4440db2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:30.753940 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.auth.core [None req-73053a0a-5d57-4c74-847f-d151b4440db2 None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:26:30.756240 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.fernet_utils [None req-73053a0a-5d57-4c74-847f-d151b4440db2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:26:30.826622 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37354f62-93a0-4726-860d-46667a9693e8 None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:30.830504 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:30.857188 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 114/220] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:26:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 08:26:30.882642 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73053a0a-5d57-4c74-847f-d151b4440db2 None None] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:30.886653 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a104de2-62c2-49b8-8391-54df3f41d32a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:30.887461 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a104de2-62c2-49b8-8391-54df3f41d32a None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:30.887743 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a104de2-62c2-49b8-8391-54df3f41d32a None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:30.888019 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a104de2-62c2-49b8-8391-54df3f41d32a None admin] PATH_INFO: `/v3/projects/7086655a913e49b899fae73f13ec6c42` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:30.889299 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a104de2-62c2-49b8-8391-54df3f41d32a None admin] RBAC: Authorizing `identity:get_project(project_id=7086655a913e49b899fae73f13ec6c42)` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:30.890754 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a104de2-62c2-49b8-8391-54df3f41d32a None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:30.892831 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 107/221] 10.222.0.62 () {56 vars in 1186 bytes} [Fri May 27 08:26:30 2022] GET /identity/v3/projects/7086655a913e49b899fae73f13ec6c42 => generated 302 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:26:30.900642 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a104de2-62c2-49b8-8391-54df3f41d32a None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:31.018290 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73053a0a-5d57-4c74-847f-d151b4440db2 None None] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:31.037724 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:31.045852 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a104de2-62c2-49b8-8391-54df3f41d32a None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:31.064152 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9300bccf-7227-4d78-b5ea-49f3783a8ab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:31.065004 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9300bccf-7227-4d78-b5ea-49f3783a8ab4 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:31.065703 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9300bccf-7227-4d78-b5ea-49f3783a8ab4 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:31.065987 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9300bccf-7227-4d78-b5ea-49f3783a8ab4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:31.079681 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9300bccf-7227-4d78-b5ea-49f3783a8ab4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 08:26:31.089414 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application [None req-9300bccf-7227-4d78-b5ea-49f3783a8ab4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 08:26:31.089414 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:26:31.089414 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:26:31.089414 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:26:31.089414 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:26:31.089414 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:26:31.089414 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:26:31.089414 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:26:31.089414 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:26:31.089414 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:26:31.089414 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:26:31.089414 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:26:31.089414 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 08:26:31.089414 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 08:26:31.089414 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 08:26:31.089414 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 08:26:31.090326 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 08:26:31.090326 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 08:26:31.090326 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 08:26:31.090326 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 08:26:31.090326 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:26:31.090326 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:26:31.090326 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:26:31.090326 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:26:31.090326 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:26:31.090326 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:26:31.090326 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:26:31.090326 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application with Lock( May 27 08:26:31.090326 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:26:31.090326 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._enter() May 27 08:26:31.090326 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:26:31.090326 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:26:31.091332 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:26:31.091332 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.creator() May 27 08:26:31.091332 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:26:31.091332 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application created_value = creator( May 27 08:26:31.091332 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 08:26:31.091332 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 08:26:31.091332 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 08:26:31.091332 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 08:26:31.091332 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 08:26:31.091332 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 08:26:31.091332 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 08:26:31.091332 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application May 27 08:26:31.091941 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3e9f51-cbc4-40b4-a3b0-8766d6e55a9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:31.091941 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3e9f51-cbc4-40b4-a3b0-8766d6e55a9f None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:31.092085 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 115/222] 10.222.0.62 () {56 vars in 1096 bytes} [Fri May 27 08:26:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 08:26:31.092150 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3e9f51-cbc4-40b4-a3b0-8766d6e55a9f None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:31.092150 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3e9f51-cbc4-40b4-a3b0-8766d6e55a9f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:31.092150 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3e9f51-cbc4-40b4-a3b0-8766d6e55a9f None admin] RBAC: Adding query filter params (role.id=c980c64bb84b418daa012ae45a054b37, scope.project.id=7086655a913e49b899fae73f13ec6c42, user.id=a488d5a3047046b18d9aecffcf353431) {{(pid=87172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:26:31.092323 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3e9f51-cbc4-40b4-a3b0-8766d6e55a9f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:31.098590 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3e9f51-cbc4-40b4-a3b0-8766d6e55a9f None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:31.100464 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9300bccf-7227-4d78-b5ea-49f3783a8ab4 None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:31.106596 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 108/223] 10.222.0.62 () {56 vars in 1374 bytes} [Fri May 27 08:26:30 2022] GET /identity/v3/role_assignments?user.id=a488d5a3047046b18d9aecffcf353431&scope.project.id=7086655a913e49b899fae73f13ec6c42&role.id=c980c64bb84b418daa012ae45a054b37 => generated 259 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:26:31.232525 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9300bccf-7227-4d78-b5ea-49f3783a8ab4 None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:31.296487 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87ffe64-18fa-4057-85df-190e1624d6ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:31.298079 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87ffe64-18fa-4057-85df-190e1624d6ad None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:31.298799 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87ffe64-18fa-4057-85df-190e1624d6ad None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:31.299537 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87ffe64-18fa-4057-85df-190e1624d6ad None admin] PATH_INFO: `/v3/roles` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:31.301299 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87ffe64-18fa-4057-85df-190e1624d6ad None admin] RBAC: Adding query filter params (name=admin) {{(pid=87173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:26:31.302116 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87ffe64-18fa-4057-85df-190e1624d6ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:31.304801 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87ffe64-18fa-4057-85df-190e1624d6ad None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:31.319800 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 116/224] 10.222.0.62 () {56 vars in 1099 bytes} [Fri May 27 08:26:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 08:26:31.330351 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3e9f51-cbc4-40b4-a3b0-8766d6e55a9f None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:31.384454 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:31.468281 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3e9f51-cbc4-40b4-a3b0-8766d6e55a9f None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:31.509728 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52a39e4-79dd-44e4-95d3-54584c5cc734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:31.510978 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52a39e4-79dd-44e4-95d3-54584c5cc734 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:31.511493 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52a39e4-79dd-44e4-95d3-54584c5cc734 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:31.511984 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52a39e4-79dd-44e4-95d3-54584c5cc734 None admin] PATH_INFO: `/v3/users/1d53a0c91b194cbca182f2e226522ad9` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:31.513436 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52a39e4-79dd-44e4-95d3-54584c5cc734 None admin] RBAC: Authorizing `identity:get_user(user_id=1d53a0c91b194cbca182f2e226522ad9)` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:31.515117 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52a39e4-79dd-44e4-95d3-54584c5cc734 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:31.522827 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 109/225] 10.222.0.62 () {56 vars in 1177 bytes} [Fri May 27 08:26:31 2022] GET /identity/v3/users/1d53a0c91b194cbca182f2e226522ad9 => generated 283 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:26:31.524506 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87ffe64-18fa-4057-85df-190e1624d6ad None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:31.563533 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:31.658280 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87ffe64-18fa-4057-85df-190e1624d6ad None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:31.698194 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d9c054-dd4c-4ee6-86db-347ae9034ca8 None None] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:31.698520 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d9c054-dd4c-4ee6-86db-347ae9034ca8 None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:31.698762 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d9c054-dd4c-4ee6-86db-347ae9034ca8 None None] PATH_INFO: `/` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:31.700142 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 110/226] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:26:31 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 08:26:31.704538 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f786042-c4c3-46d4-8a95-0f8af3e3bb8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:31.705389 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bdb866-7894-4bc0-8c1c-1ded2cbf51b3 None None] REQUEST_METHOD: `POST` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:31.705686 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bdb866-7894-4bc0-8c1c-1ded2cbf51b3 None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:31.705969 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bdb866-7894-4bc0-8c1c-1ded2cbf51b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:31.706330 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f786042-c4c3-46d4-8a95-0f8af3e3bb8c None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:31.706806 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f786042-c4c3-46d4-8a95-0f8af3e3bb8c None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:31.707394 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f786042-c4c3-46d4-8a95-0f8af3e3bb8c None admin] PATH_INFO: `/v3/projects/7086655a913e49b899fae73f13ec6c42` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:31.708945 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f786042-c4c3-46d4-8a95-0f8af3e3bb8c None admin] RBAC: Authorizing `identity:get_project(project_id=7086655a913e49b899fae73f13ec6c42)` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:31.710649 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f786042-c4c3-46d4-8a95-0f8af3e3bb8c None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:31.712644 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 117/227] 10.222.0.62 () {56 vars in 1186 bytes} [Fri May 27 08:26:31 2022] GET /identity/v3/projects/7086655a913e49b899fae73f13ec6c42 => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:26:31.718741 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f786042-c4c3-46d4-8a95-0f8af3e3bb8c None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:31.743275 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.auth.core [None req-a7bdb866-7894-4bc0-8c1c-1ded2cbf51b3 None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:26:31.744581 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.fernet_utils [None req-a7bdb866-7894-4bc0-8c1c-1ded2cbf51b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:26:31.872494 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 111/228] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:26:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 08:26:31.900567 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f786042-c4c3-46d4-8a95-0f8af3e3bb8c None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:31.903026 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:31.908207 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bdb866-7894-4bc0-8c1c-1ded2cbf51b3 None None] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:31.981341 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:31.989326 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06deea81-5fde-46fe-91ae-d5b9692621d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:31.990250 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06deea81-5fde-46fe-91ae-d5b9692621d2 None admin] REQUEST_METHOD: `PUT` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:31.990535 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06deea81-5fde-46fe-91ae-d5b9692621d2 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:31.990814 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06deea81-5fde-46fe-91ae-d5b9692621d2 None admin] PATH_INFO: `/v3/projects/7086655a913e49b899fae73f13ec6c42/users/1d53a0c91b194cbca182f2e226522ad9/roles/5e6f243a7201412c965e7c70249d4dc0` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:31.996622 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06deea81-5fde-46fe-91ae-d5b9692621d2 None admin] RBAC: Authorizing `identity:create_grant(project_id=7086655a913e49b899fae73f13ec6c42, user_id=1d53a0c91b194cbca182f2e226522ad9, role_id=5e6f243a7201412c965e7c70249d4dc0)` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:31.998115 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06deea81-5fde-46fe-91ae-d5b9692621d2 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:32.021194 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 118/229] 10.222.0.62 () {58 vars in 1439 bytes} [Fri May 27 08:26:31 2022] PUT /identity/v3/projects/7086655a913e49b899fae73f13ec6c42/users/1d53a0c91b194cbca182f2e226522ad9/roles/5e6f243a7201412c965e7c70249d4dc0 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 08:26:32.078963 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bdb866-7894-4bc0-8c1c-1ded2cbf51b3 None None] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:32.119406 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06023f0c-bcfa-4ddc-8060-41c0ede139fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:32.120233 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06023f0c-bcfa-4ddc-8060-41c0ede139fb None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:32.120520 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06023f0c-bcfa-4ddc-8060-41c0ede139fb None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:32.120831 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06023f0c-bcfa-4ddc-8060-41c0ede139fb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:32.134065 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06023f0c-bcfa-4ddc-8060-41c0ede139fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 08:26:32.143085 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application [None req-06023f0c-bcfa-4ddc-8060-41c0ede139fb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 08:26:32.143085 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:26:32.143085 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:26:32.143085 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:26:32.143085 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:26:32.143085 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:26:32.143085 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:26:32.143085 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:26:32.143085 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:26:32.143085 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:26:32.143085 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:26:32.143085 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:26:32.143085 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 08:26:32.143085 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 08:26:32.143085 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 08:26:32.143085 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 08:26:32.144077 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 08:26:32.144077 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 08:26:32.144077 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 08:26:32.144077 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 08:26:32.144077 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:26:32.144077 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:26:32.144077 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:26:32.144077 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:26:32.144077 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:26:32.144077 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:26:32.144077 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:26:32.144077 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application with Lock( May 27 08:26:32.144077 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:26:32.144077 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._enter() May 27 08:26:32.144077 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:26:32.144077 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:26:32.145565 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:26:32.145565 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.creator() May 27 08:26:32.145565 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:26:32.145565 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application created_value = creator( May 27 08:26:32.145565 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 08:26:32.145565 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 08:26:32.145565 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 08:26:32.145565 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 08:26:32.145565 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 08:26:32.145565 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 08:26:32.145565 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 08:26:32.145565 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application May 27 08:26:32.145565 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 112/230] 10.222.0.62 () {56 vars in 1114 bytes} [Fri May 27 08:26:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 08:26:32.151134 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06deea81-5fde-46fe-91ae-d5b9692621d2 None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:32.300388 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06deea81-5fde-46fe-91ae-d5b9692621d2 None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:32.337941 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef908cd3-f0a3-49a5-997d-58b7a86faeee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:32.338964 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef908cd3-f0a3-49a5-997d-58b7a86faeee None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:32.339470 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef908cd3-f0a3-49a5-997d-58b7a86faeee None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:32.340042 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef908cd3-f0a3-49a5-997d-58b7a86faeee None admin] PATH_INFO: `/v3/roles` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:32.341035 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef908cd3-f0a3-49a5-997d-58b7a86faeee None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:26:32.341549 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef908cd3-f0a3-49a5-997d-58b7a86faeee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:32.343141 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef908cd3-f0a3-49a5-997d-58b7a86faeee None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:32.353166 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 119/231] 10.222.0.62 () {56 vars in 1111 bytes} [Fri May 27 08:26:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:26:32.359543 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06023f0c-bcfa-4ddc-8060-41c0ede139fb None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:32.478602 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:32.486638 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06023f0c-bcfa-4ddc-8060-41c0ede139fb None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:32.538602 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed3dafa-ad09-49c3-8165-5a946218cde5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:32.539497 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed3dafa-ad09-49c3-8165-5a946218cde5 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:32.539784 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed3dafa-ad09-49c3-8165-5a946218cde5 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:32.540064 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed3dafa-ad09-49c3-8165-5a946218cde5 None admin] PATH_INFO: `/v3/users/1d53a0c91b194cbca182f2e226522ad9` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:32.541325 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed3dafa-ad09-49c3-8165-5a946218cde5 None admin] RBAC: Authorizing `identity:get_user(user_id=1d53a0c91b194cbca182f2e226522ad9)` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:32.542801 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed3dafa-ad09-49c3-8165-5a946218cde5 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:32.544774 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 113/232] 10.222.0.62 () {56 vars in 1177 bytes} [Fri May 27 08:26:32 2022] GET /identity/v3/users/1d53a0c91b194cbca182f2e226522ad9 => generated 283 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 08:26:32.550276 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef908cd3-f0a3-49a5-997d-58b7a86faeee None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:32.617008 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:32.720382 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef908cd3-f0a3-49a5-997d-58b7a86faeee None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:32.773383 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fe2823-ef39-43d8-8112-16b64e3c2c7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:32.774163 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fe2823-ef39-43d8-8112-16b64e3c2c7f None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:32.774440 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fe2823-ef39-43d8-8112-16b64e3c2c7f None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:32.774715 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fe2823-ef39-43d8-8112-16b64e3c2c7f None admin] PATH_INFO: `/v3/projects/7086655a913e49b899fae73f13ec6c42` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:32.775939 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fe2823-ef39-43d8-8112-16b64e3c2c7f None admin] RBAC: Authorizing `identity:get_project(project_id=7086655a913e49b899fae73f13ec6c42)` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:32.777431 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fe2823-ef39-43d8-8112-16b64e3c2c7f None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:32.779438 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 120/233] 10.222.0.62 () {56 vars in 1186 bytes} [Fri May 27 08:26:32 2022] GET /identity/v3/projects/7086655a913e49b899fae73f13ec6c42 => generated 302 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:26:32.784736 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed3dafa-ad09-49c3-8165-5a946218cde5 None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:32.924556 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed3dafa-ad09-49c3-8165-5a946218cde5 None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:32.968246 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76943de5-84bc-4c13-a541-aa43a04df3ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:32.969590 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76943de5-84bc-4c13-a541-aa43a04df3ce None admin] REQUEST_METHOD: `PUT` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:32.970115 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76943de5-84bc-4c13-a541-aa43a04df3ce None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:32.970625 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76943de5-84bc-4c13-a541-aa43a04df3ce None admin] PATH_INFO: `/v3/projects/7086655a913e49b899fae73f13ec6c42/users/1d53a0c91b194cbca182f2e226522ad9/roles/9ff71fb5e7b7407d8d243eaa7da0a125` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:32.977938 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76943de5-84bc-4c13-a541-aa43a04df3ce None admin] RBAC: Authorizing `identity:create_grant(project_id=7086655a913e49b899fae73f13ec6c42, user_id=1d53a0c91b194cbca182f2e226522ad9, role_id=9ff71fb5e7b7407d8d243eaa7da0a125)` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:32.980224 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76943de5-84bc-4c13-a541-aa43a04df3ce None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:33.005425 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 114/234] 10.222.0.62 () {58 vars in 1439 bytes} [Fri May 27 08:26:32 2022] PUT /identity/v3/projects/7086655a913e49b899fae73f13ec6c42/users/1d53a0c91b194cbca182f2e226522ad9/roles/9ff71fb5e7b7407d8d243eaa7da0a125 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 08:26:33.851522 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77d7aa9-edb1-43b9-981f-9aed53149b7e None None] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:33.852028 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77d7aa9-edb1-43b9-981f-9aed53149b7e None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:33.852102 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77d7aa9-edb1-43b9-981f-9aed53149b7e None None] PATH_INFO: `/` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:33.853644 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 121/235] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:26:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:26:33.858706 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae96d43c-45fc-4d58-9244-10cfb13a9e70 None None] REQUEST_METHOD: `POST` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:33.859550 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae96d43c-45fc-4d58-9244-10cfb13a9e70 None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:33.860053 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae96d43c-45fc-4d58-9244-10cfb13a9e70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:33.880886 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.auth.core [None req-ae96d43c-45fc-4d58-9244-10cfb13a9e70 None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:26:33.882606 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.fernet_utils [None req-ae96d43c-45fc-4d58-9244-10cfb13a9e70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:26:33.908361 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:33.977980 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 115/236] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:26:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 08:26:34.017003 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77d7aa9-edb1-43b9-981f-9aed53149b7e None None] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:34.125164 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fa0796-c5ff-4c2b-9b5d-eba04c4ee5d1 None None] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:34.125480 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fa0796-c5ff-4c2b-9b5d-eba04c4ee5d1 None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:34.125719 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fa0796-c5ff-4c2b-9b5d-eba04c4ee5d1 None None] PATH_INFO: `/` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:34.127364 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 116/237] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:26:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 08:26:34.128009 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:34.135490 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da92f9d8-dc00-4f64-9015-15b85f08839d None None] REQUEST_METHOD: `POST` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:34.136071 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da92f9d8-dc00-4f64-9015-15b85f08839d None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:34.136549 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da92f9d8-dc00-4f64-9015-15b85f08839d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:34.142199 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77d7aa9-edb1-43b9-981f-9aed53149b7e None None] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:34.157059 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.auth.core [None req-da92f9d8-dc00-4f64-9015-15b85f08839d None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:26:34.158676 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.fernet_utils [None req-da92f9d8-dc00-4f64-9015-15b85f08839d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:26:34.183817 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cba6ed8-8fa6-459d-b48a-9957a4f46002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:34.185054 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cba6ed8-8fa6-459d-b48a-9957a4f46002 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:34.185342 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cba6ed8-8fa6-459d-b48a-9957a4f46002 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:34.185672 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cba6ed8-8fa6-459d-b48a-9957a4f46002 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:34.186904 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cba6ed8-8fa6-459d-b48a-9957a4f46002 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:34.188428 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cba6ed8-8fa6-459d-b48a-9957a4f46002 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:34.190429 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 122/238] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 08:26:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:26:34.191922 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee73305-fc80-4fd9-a527-44761cec83ae None None] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:34.192214 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee73305-fc80-4fd9-a527-44761cec83ae None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:34.192489 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee73305-fc80-4fd9-a527-44761cec83ae None None] PATH_INFO: `/` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:34.198583 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 123/239] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:26:34 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:26:34.199357 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee73305-fc80-4fd9-a527-44761cec83ae None None] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:34.241327 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 117/240] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:26:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 08:26:34.248612 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8489865c-c7a9-4b4f-8b6b-1789af5105da None None] REQUEST_METHOD: `POST` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:34.249376 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8489865c-c7a9-4b4f-8b6b-1789af5105da None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:34.249851 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8489865c-c7a9-4b4f-8b6b-1789af5105da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:34.281755 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.auth.core [None req-8489865c-c7a9-4b4f-8b6b-1789af5105da None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:26:34.283301 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.fernet_utils [None req-8489865c-c7a9-4b4f-8b6b-1789af5105da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:26:34.311654 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee73305-fc80-4fd9-a527-44761cec83ae None None] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:34.350196 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905d50cc-34cb-4544-b0ae-48d36626eb15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:34.350872 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905d50cc-34cb-4544-b0ae-48d36626eb15 None admin] REQUEST_METHOD: `POST` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:34.351155 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905d50cc-34cb-4544-b0ae-48d36626eb15 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:34.351430 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905d50cc-34cb-4544-b0ae-48d36626eb15 None admin] PATH_INFO: `/v3/users` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:34.352291 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905d50cc-34cb-4544-b0ae-48d36626eb15 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:34.353824 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905d50cc-34cb-4544-b0ae-48d36626eb15 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:34.367457 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 118/241] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:26:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 08:26:34.368632 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8489865c-c7a9-4b4f-8b6b-1789af5105da None None] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:34.384963 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:34.388378 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 124/242] 10.222.0.62 () {60 vars in 1132 bytes} [Fri May 27 08:26:34 2022] POST /identity/v3/users => generated 293 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 08:26:34.423549 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905d50cc-34cb-4544-b0ae-48d36626eb15 None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:34.470579 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:34.486389 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8489865c-c7a9-4b4f-8b6b-1789af5105da None None] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:34.547254 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4543e618-575f-4a46-b321-aa5bf0322e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:34.548493 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4543e618-575f-4a46-b321-aa5bf0322e6e None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:34.549013 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4543e618-575f-4a46-b321-aa5bf0322e6e None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:34.549306 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4543e618-575f-4a46-b321-aa5bf0322e6e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:34.566726 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4543e618-575f-4a46-b321-aa5bf0322e6e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 08:26:34.579915 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application [None req-4543e618-575f-4a46-b321-aa5bf0322e6e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 27 08:26:34.579915 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:26:34.579915 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:26:34.579915 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:26:34.579915 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:26:34.579915 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:26:34.579915 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:26:34.579915 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:26:34.579915 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:26:34.579915 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:26:34.579915 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:26:34.579915 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:26:34.579915 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 08:26:34.579915 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 08:26:34.579915 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 08:26:34.579915 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 08:26:34.580932 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 08:26:34.580932 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 08:26:34.580932 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 08:26:34.580932 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 08:26:34.580932 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:26:34.580932 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:26:34.580932 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:26:34.580932 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:26:34.580932 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:26:34.580932 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:26:34.580932 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:26:34.580932 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application with Lock( May 27 08:26:34.580932 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:26:34.580932 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._enter() May 27 08:26:34.580932 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:26:34.580932 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:26:34.581762 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:26:34.581762 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.creator() May 27 08:26:34.581762 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:26:34.581762 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application created_value = creator( May 27 08:26:34.581762 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 08:26:34.581762 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 08:26:34.581762 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 08:26:34.581762 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 08:26:34.581762 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 08:26:34.581762 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 08:26:34.581762 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 27 08:26:34.581762 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application May 27 08:26:34.589109 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 119/243] 10.222.0.62 () {56 vars in 1099 bytes} [Fri May 27 08:26:34 2022] GET /identity/v3/roles/reader => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 08:26:34.600718 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4543e618-575f-4a46-b321-aa5bf0322e6e None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:34.685132 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905d50cc-34cb-4544-b0ae-48d36626eb15 None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:34.742493 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcb0e33-4520-4e8f-8446-82cc5d6b4f26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:34.743312 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcb0e33-4520-4e8f-8446-82cc5d6b4f26 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:34.743595 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcb0e33-4520-4e8f-8446-82cc5d6b4f26 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:34.743872 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcb0e33-4520-4e8f-8446-82cc5d6b4f26 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:34.755707 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcb0e33-4520-4e8f-8446-82cc5d6b4f26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 08:26:34.766344 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application [None req-1bcb0e33-4520-4e8f-8446-82cc5d6b4f26 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 08:26:34.766344 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:26:34.766344 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:26:34.766344 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:26:34.766344 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:26:34.766344 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:26:34.766344 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:26:34.766344 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:26:34.766344 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:26:34.766344 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:26:34.766344 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:26:34.766344 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:26:34.766344 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 08:26:34.766344 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 08:26:34.766344 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 08:26:34.766344 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 08:26:34.768233 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 08:26:34.768233 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 08:26:34.768233 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 08:26:34.768233 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 08:26:34.768233 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:26:34.768233 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:26:34.768233 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:26:34.768233 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:26:34.768233 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:26:34.768233 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:26:34.768233 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:26:34.768233 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application with Lock( May 27 08:26:34.768233 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:26:34.768233 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._enter() May 27 08:26:34.768233 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:26:34.768233 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:26:34.769939 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:26:34.769939 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.creator() May 27 08:26:34.769939 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:26:34.769939 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application created_value = creator( May 27 08:26:34.769939 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 08:26:34.769939 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 08:26:34.769939 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 08:26:34.769939 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 08:26:34.769939 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 08:26:34.769939 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 08:26:34.769939 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 08:26:34.769939 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application May 27 08:26:34.769939 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 125/244] 10.222.0.62 () {56 vars in 1099 bytes} [Fri May 27 08:26:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 345 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 08:26:34.770969 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:34.777903 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcb0e33-4520-4e8f-8446-82cc5d6b4f26 None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:34.780573 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4543e618-575f-4a46-b321-aa5bf0322e6e None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:34.828957 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6409e13b-934b-40dc-8bfd-5d35c7c7f274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:34.829598 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6409e13b-934b-40dc-8bfd-5d35c7c7f274 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:34.829879 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6409e13b-934b-40dc-8bfd-5d35c7c7f274 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:34.830163 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6409e13b-934b-40dc-8bfd-5d35c7c7f274 None admin] PATH_INFO: `/v3/roles` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:34.830956 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6409e13b-934b-40dc-8bfd-5d35c7c7f274 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:26:34.831269 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6409e13b-934b-40dc-8bfd-5d35c7c7f274 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:34.833059 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6409e13b-934b-40dc-8bfd-5d35c7c7f274 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:34.848932 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 120/245] 10.222.0.62 () {56 vars in 1101 bytes} [Fri May 27 08:26:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:26:34.850960 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6409e13b-934b-40dc-8bfd-5d35c7c7f274 None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:34.927365 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:34.960209 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcb0e33-4520-4e8f-8446-82cc5d6b4f26 None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:34.993627 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6409e13b-934b-40dc-8bfd-5d35c7c7f274 None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:35.004992 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a2d384-3d40-4890-b735-f330009fbfb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:35.005879 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a2d384-3d40-4890-b735-f330009fbfb8 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:35.006267 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a2d384-3d40-4890-b735-f330009fbfb8 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:35.006996 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a2d384-3d40-4890-b735-f330009fbfb8 None admin] PATH_INFO: `/v3/roles` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:35.007658 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a2d384-3d40-4890-b735-f330009fbfb8 None admin] RBAC: Adding query filter params (name=member) {{(pid=87173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:26:35.008246 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a2d384-3d40-4890-b735-f330009fbfb8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:35.009846 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a2d384-3d40-4890-b735-f330009fbfb8 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:35.023717 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 126/246] 10.222.0.62 () {56 vars in 1101 bytes} [Fri May 27 08:26:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:26:35.031165 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a2d384-3d40-4890-b735-f330009fbfb8 None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:35.040169 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972cd561-1cfd-4fe7-b628-d8b2e93c6a4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:35.042057 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972cd561-1cfd-4fe7-b628-d8b2e93c6a4b None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:35.042348 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972cd561-1cfd-4fe7-b628-d8b2e93c6a4b None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:35.042628 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972cd561-1cfd-4fe7-b628-d8b2e93c6a4b None admin] PATH_INFO: `/v3/users/4f1cc13b7189408f8d266885ec60d9eb` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:35.044915 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:35.063201 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972cd561-1cfd-4fe7-b628-d8b2e93c6a4b None admin] RBAC: Authorizing `identity:get_user(user_id=4f1cc13b7189408f8d266885ec60d9eb)` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:35.065657 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972cd561-1cfd-4fe7-b628-d8b2e93c6a4b None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:35.066862 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 121/247] 10.222.0.62 () {56 vars in 1177 bytes} [Fri May 27 08:26:34 2022] GET /identity/v3/users/4f1cc13b7189408f8d266885ec60d9eb => generated 297 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 08:26:35.068227 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84b253c-8a56-436a-b396-a7d9fcfb841e None None] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:35.068520 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84b253c-8a56-436a-b396-a7d9fcfb841e None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:35.068848 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84b253c-8a56-436a-b396-a7d9fcfb841e None None] PATH_INFO: `/` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:35.070232 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 122/248] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:26:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:26:35.072049 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84b253c-8a56-436a-b396-a7d9fcfb841e None None] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:35.168418 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a2d384-3d40-4890-b735-f330009fbfb8 None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:35.200427 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84b253c-8a56-436a-b396-a7d9fcfb841e None None] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:35.227310 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae076c9-8c12-4829-b6f5-0f085d5816b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:35.229632 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae076c9-8c12-4829-b6f5-0f085d5816b0 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:35.229921 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae076c9-8c12-4829-b6f5-0f085d5816b0 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:35.230205 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae076c9-8c12-4829-b6f5-0f085d5816b0 None admin] PATH_INFO: `/v3/users/a488d5a3047046b18d9aecffcf353431` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:35.233364 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae076c9-8c12-4829-b6f5-0f085d5816b0 None admin] RBAC: Authorizing `identity:get_user(user_id=a488d5a3047046b18d9aecffcf353431)` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:35.237423 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae076c9-8c12-4829-b6f5-0f085d5816b0 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:35.243921 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 127/249] 10.222.0.62 () {56 vars in 1177 bytes} [Fri May 27 08:26:35 2022] GET /identity/v3/users/a488d5a3047046b18d9aecffcf353431 => generated 297 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 08:26:35.248219 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f60b72-1160-419d-a33a-2b948628155e None None] REQUEST_METHOD: `POST` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:35.248519 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f60b72-1160-419d-a33a-2b948628155e None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:35.254465 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f60b72-1160-419d-a33a-2b948628155e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:35.271361 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a9de43-81c6-498d-a27f-298886f2cba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:35.272129 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a9de43-81c6-498d-a27f-298886f2cba7 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:35.272424 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a9de43-81c6-498d-a27f-298886f2cba7 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:35.272736 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a9de43-81c6-498d-a27f-298886f2cba7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:35.289354 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.auth.core [None req-66f60b72-1160-419d-a33a-2b948628155e None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:26:35.290586 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.fernet_utils [None req-66f60b72-1160-419d-a33a-2b948628155e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:26:35.296921 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:35.403504 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:35.414991 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 128/250] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:26:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 08:26:35.415882 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f60b72-1160-419d-a33a-2b948628155e None None] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:35.422676 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a9de43-81c6-498d-a27f-298886f2cba7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:35.428554 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a9de43-81c6-498d-a27f-298886f2cba7 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:35.552083 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 123/251] 10.222.0.62 () {58 vars in 1282 bytes} [Fri May 27 08:26:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 27 08:26:35.556803 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a9de43-81c6-498d-a27f-298886f2cba7 None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:35.618590 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f60b72-1160-419d-a33a-2b948628155e None None] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:35.657239 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:35.663941 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a9de43-81c6-498d-a27f-298886f2cba7 None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:35.710196 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd07eac-9580-4996-a4a3-73dc864cf04e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:35.711117 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd07eac-9580-4996-a4a3-73dc864cf04e None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:35.711405 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd07eac-9580-4996-a4a3-73dc864cf04e None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:35.711682 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd07eac-9580-4996-a4a3-73dc864cf04e None admin] PATH_INFO: `/v3/projects/7086655a913e49b899fae73f13ec6c42` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:35.714040 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd07eac-9580-4996-a4a3-73dc864cf04e None admin] RBAC: Authorizing `identity:get_project(project_id=7086655a913e49b899fae73f13ec6c42)` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:35.715530 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd07eac-9580-4996-a4a3-73dc864cf04e None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:35.717318 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 129/252] 10.222.0.62 () {56 vars in 1186 bytes} [Fri May 27 08:26:35 2022] GET /identity/v3/projects/7086655a913e49b899fae73f13ec6c42 => generated 302 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:26:35.718105 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd07eac-9580-4996-a4a3-73dc864cf04e None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:35.738776 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec638df-e604-4860-82da-365d3a6e9ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:35.739700 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec638df-e604-4860-82da-365d3a6e9ed0 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:35.739991 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec638df-e604-4860-82da-365d3a6e9ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:35.740274 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec638df-e604-4860-82da-365d3a6e9ed0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:35.745859 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:35.767260 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec638df-e604-4860-82da-365d3a6e9ed0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 08:26:35.777850 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application [None req-cec638df-e604-4860-82da-365d3a6e9ed0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 08:26:35.777850 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:26:35.777850 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:26:35.777850 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:26:35.777850 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:26:35.777850 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:26:35.777850 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:26:35.777850 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:26:35.777850 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:26:35.777850 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:26:35.777850 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:26:35.777850 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:26:35.777850 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 08:26:35.777850 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 08:26:35.777850 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 08:26:35.777850 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 08:26:35.778843 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 08:26:35.778843 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 08:26:35.778843 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 08:26:35.778843 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 08:26:35.778843 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:26:35.778843 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:26:35.778843 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:26:35.778843 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:26:35.778843 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:26:35.778843 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:26:35.778843 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:26:35.778843 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application with Lock( May 27 08:26:35.778843 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:26:35.778843 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._enter() May 27 08:26:35.778843 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:26:35.778843 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:26:35.780336 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:26:35.780336 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.creator() May 27 08:26:35.780336 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:26:35.780336 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application created_value = creator( May 27 08:26:35.780336 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 08:26:35.780336 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 08:26:35.780336 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 08:26:35.780336 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 08:26:35.780336 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 08:26:35.780336 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 08:26:35.780336 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 08:26:35.780336 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application May 27 08:26:35.787125 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 124/253] 10.222.0.62 () {56 vars in 1096 bytes} [Fri May 27 08:26:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 08:26:35.789413 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec638df-e604-4860-82da-365d3a6e9ed0 None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:35.934740 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec638df-e604-4860-82da-365d3a6e9ed0 None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:35.980062 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc82071a-c42d-449c-950e-f8d91652e6b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:35.980993 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc82071a-c42d-449c-950e-f8d91652e6b3 None admin] REQUEST_METHOD: `PUT` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:35.981300 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc82071a-c42d-449c-950e-f8d91652e6b3 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:35.981858 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc82071a-c42d-449c-950e-f8d91652e6b3 None admin] PATH_INFO: `/v3/projects/7086655a913e49b899fae73f13ec6c42/users/a488d5a3047046b18d9aecffcf353431/roles/c980c64bb84b418daa012ae45a054b37` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:35.984499 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc82071a-c42d-449c-950e-f8d91652e6b3 None admin] RBAC: Authorizing `identity:create_grant(project_id=7086655a913e49b899fae73f13ec6c42, user_id=a488d5a3047046b18d9aecffcf353431, role_id=c980c64bb84b418daa012ae45a054b37)` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:35.985936 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd07eac-9580-4996-a4a3-73dc864cf04e None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:35.986367 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc82071a-c42d-449c-950e-f8d91652e6b3 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:36.006936 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 125/254] 10.222.0.62 () {58 vars in 1439 bytes} [Fri May 27 08:26:35 2022] PUT /identity/v3/projects/7086655a913e49b899fae73f13ec6c42/users/a488d5a3047046b18d9aecffcf353431/roles/c980c64bb84b418daa012ae45a054b37 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 08:26:36.007975 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc82071a-c42d-449c-950e-f8d91652e6b3 None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:36.029936 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:36.031706 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc4e510-d2f8-4a00-b478-ae386ef1c9bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:36.033368 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc4e510-d2f8-4a00-b478-ae386ef1c9bb None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:36.033930 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc4e510-d2f8-4a00-b478-ae386ef1c9bb None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:36.034424 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc4e510-d2f8-4a00-b478-ae386ef1c9bb None admin] PATH_INFO: `/v3/projects/7086655a913e49b899fae73f13ec6c42` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:36.036489 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc4e510-d2f8-4a00-b478-ae386ef1c9bb None admin] RBAC: Authorizing `identity:get_project(project_id=7086655a913e49b899fae73f13ec6c42)` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:36.038702 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc4e510-d2f8-4a00-b478-ae386ef1c9bb None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:36.040980 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 130/255] 10.222.0.62 () {56 vars in 1186 bytes} [Fri May 27 08:26:35 2022] GET /identity/v3/projects/7086655a913e49b899fae73f13ec6c42 => generated 302 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:26:36.042591 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77abb10b-adc0-419b-8a5d-a26ce81996a1 None None] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:36.043082 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77abb10b-adc0-419b-8a5d-a26ce81996a1 None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:36.043561 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77abb10b-adc0-419b-8a5d-a26ce81996a1 None None] PATH_INFO: `/` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:36.045389 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 131/256] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:26:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:26:36.049518 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77abb10b-adc0-419b-8a5d-a26ce81996a1 None None] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:36.153197 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc82071a-c42d-449c-950e-f8d91652e6b3 None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:36.194831 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:36.206242 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eae62f5-1212-418f-a8ce-a749a3d4d779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:36.208467 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eae62f5-1212-418f-a8ce-a749a3d4d779 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:36.209065 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eae62f5-1212-418f-a8ce-a749a3d4d779 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:36.210342 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eae62f5-1212-418f-a8ce-a749a3d4d779 None admin] PATH_INFO: `/v3/roles` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:36.212657 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eae62f5-1212-418f-a8ce-a749a3d4d779 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:26:36.213265 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eae62f5-1212-418f-a8ce-a749a3d4d779 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:36.214888 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eae62f5-1212-418f-a8ce-a749a3d4d779 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:36.226623 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 126/257] 10.222.0.62 () {56 vars in 1099 bytes} [Fri May 27 08:26:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:26:36.228310 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24366d25-ec56-4803-b9a9-98e1f036d635 None None] REQUEST_METHOD: `POST` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:36.228773 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24366d25-ec56-4803-b9a9-98e1f036d635 None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:36.229193 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24366d25-ec56-4803-b9a9-98e1f036d635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:36.252386 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.auth.core [None req-24366d25-ec56-4803-b9a9-98e1f036d635 None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:26:36.254525 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.fernet_utils [None req-24366d25-ec56-4803-b9a9-98e1f036d635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:26:36.268133 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77abb10b-adc0-419b-8a5d-a26ce81996a1 None None] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:36.314711 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276c1577-78bd-4ce3-9138-aaca4fbc4fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:36.315383 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276c1577-78bd-4ce3-9138-aaca4fbc4fb0 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:36.315670 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276c1577-78bd-4ce3-9138-aaca4fbc4fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:36.315950 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276c1577-78bd-4ce3-9138-aaca4fbc4fb0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:36.317280 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276c1577-78bd-4ce3-9138-aaca4fbc4fb0 None admin] RBAC: Adding query filter params (role.id=279cf625eaed4bac893add184f558fd1, scope.project.id=7086655a913e49b899fae73f13ec6c42, user.id=4f1cc13b7189408f8d266885ec60d9eb) {{(pid=87173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:26:36.317599 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276c1577-78bd-4ce3-9138-aaca4fbc4fb0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:36.319443 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276c1577-78bd-4ce3-9138-aaca4fbc4fb0 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:36.327204 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 132/258] 10.222.0.62 () {56 vars in 1374 bytes} [Fri May 27 08:26:36 2022] GET /identity/v3/role_assignments?user.id=4f1cc13b7189408f8d266885ec60d9eb&scope.project.id=7086655a913e49b899fae73f13ec6c42&role.id=279cf625eaed4bac893add184f558fd1 => generated 259 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:26:36.328026 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276c1577-78bd-4ce3-9138-aaca4fbc4fb0 None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:36.355117 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 127/259] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:26:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 08:26:36.389772 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24366d25-ec56-4803-b9a9-98e1f036d635 None None] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:36.397043 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:36.447498 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276c1577-78bd-4ce3-9138-aaca4fbc4fb0 None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:36.485184 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b79103-9bde-44a1-8c1b-dfae75884c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:36.486058 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b79103-9bde-44a1-8c1b-dfae75884c3a None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:36.486338 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b79103-9bde-44a1-8c1b-dfae75884c3a None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:36.486612 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b79103-9bde-44a1-8c1b-dfae75884c3a None admin] PATH_INFO: `/v3/users/1d53a0c91b194cbca182f2e226522ad9` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:36.487829 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b79103-9bde-44a1-8c1b-dfae75884c3a None admin] RBAC: Authorizing `identity:get_user(user_id=1d53a0c91b194cbca182f2e226522ad9)` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:36.489490 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b79103-9bde-44a1-8c1b-dfae75884c3a None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:36.491174 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 133/260] 10.222.0.62 () {56 vars in 1177 bytes} [Fri May 27 08:26:36 2022] GET /identity/v3/users/1d53a0c91b194cbca182f2e226522ad9 => generated 283 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:26:36.502074 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b79103-9bde-44a1-8c1b-dfae75884c3a None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:36.513178 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:36.639132 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24366d25-ec56-4803-b9a9-98e1f036d635 None None] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:36.715859 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4192c8b2-8d9b-464d-8045-a97248d7bbbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:36.716621 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4192c8b2-8d9b-464d-8045-a97248d7bbbb None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:36.716968 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4192c8b2-8d9b-464d-8045-a97248d7bbbb None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:36.717244 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4192c8b2-8d9b-464d-8045-a97248d7bbbb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:36.724888 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b79103-9bde-44a1-8c1b-dfae75884c3a None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:36.728083 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4192c8b2-8d9b-464d-8045-a97248d7bbbb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 08:26:36.740573 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application [None req-4192c8b2-8d9b-464d-8045-a97248d7bbbb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 08:26:36.740573 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:26:36.740573 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:26:36.740573 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:26:36.740573 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:26:36.740573 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:26:36.740573 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:26:36.740573 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:26:36.740573 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:26:36.740573 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:26:36.740573 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:26:36.740573 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:26:36.740573 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 08:26:36.740573 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 08:26:36.740573 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 08:26:36.740573 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 08:26:36.741603 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 08:26:36.741603 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 08:26:36.741603 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 08:26:36.741603 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 08:26:36.741603 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:26:36.741603 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:26:36.741603 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:26:36.741603 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:26:36.741603 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:26:36.741603 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:26:36.741603 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:26:36.741603 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application with Lock( May 27 08:26:36.741603 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:26:36.741603 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._enter() May 27 08:26:36.741603 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:26:36.741603 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:26:36.742411 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:26:36.742411 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.creator() May 27 08:26:36.742411 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:26:36.742411 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application created_value = creator( May 27 08:26:36.742411 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 08:26:36.742411 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 08:26:36.742411 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 08:26:36.742411 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 08:26:36.742411 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 08:26:36.742411 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 08:26:36.742411 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 08:26:36.742411 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application May 27 08:26:36.742411 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 128/261] 10.222.0.62 () {56 vars in 1114 bytes} [Fri May 27 08:26:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 353 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 08:26:36.748168 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4192c8b2-8d9b-464d-8045-a97248d7bbbb None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:36.790117 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea8159f-6e17-4b1b-a37e-2b145bdcc711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:36.790780 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea8159f-6e17-4b1b-a37e-2b145bdcc711 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:36.791069 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea8159f-6e17-4b1b-a37e-2b145bdcc711 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:36.791349 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea8159f-6e17-4b1b-a37e-2b145bdcc711 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:36.852119 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:36.938187 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4192c8b2-8d9b-464d-8045-a97248d7bbbb None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:36.938908 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea8159f-6e17-4b1b-a37e-2b145bdcc711 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:36.940440 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea8159f-6e17-4b1b-a37e-2b145bdcc711 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:36.950254 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:37.030372 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd33ebe7-a8b4-4f0c-8d92-1f9bab2e98db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:37.031447 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd33ebe7-a8b4-4f0c-8d92-1f9bab2e98db None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:37.031915 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd33ebe7-a8b4-4f0c-8d92-1f9bab2e98db None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:37.032424 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd33ebe7-a8b4-4f0c-8d92-1f9bab2e98db None admin] PATH_INFO: `/v3/roles` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:37.033443 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd33ebe7-a8b4-4f0c-8d92-1f9bab2e98db None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:26:37.034076 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd33ebe7-a8b4-4f0c-8d92-1f9bab2e98db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:37.035791 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd33ebe7-a8b4-4f0c-8d92-1f9bab2e98db None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:37.056029 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 129/262] 10.222.0.62 () {56 vars in 1111 bytes} [Fri May 27 08:26:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 08:26:37.060865 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 134/263] 10.222.0.62 () {58 vars in 1282 bytes} [Fri May 27 08:26:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 559 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 08:26:37.064690 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd33ebe7-a8b4-4f0c-8d92-1f9bab2e98db None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:37.068095 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea8159f-6e17-4b1b-a37e-2b145bdcc711 None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:37.184690 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd33ebe7-a8b4-4f0c-8d92-1f9bab2e98db None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:37.213067 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:37.226994 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7631d612-91ea-4314-9fbe-2ec4d623b642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:37.228813 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7631d612-91ea-4314-9fbe-2ec4d623b642 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:37.229467 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7631d612-91ea-4314-9fbe-2ec4d623b642 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:37.232238 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7631d612-91ea-4314-9fbe-2ec4d623b642 None admin] PATH_INFO: `/v3/users/1d53a0c91b194cbca182f2e226522ad9` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:37.234062 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7631d612-91ea-4314-9fbe-2ec4d623b642 None admin] RBAC: Authorizing `identity:get_user(user_id=1d53a0c91b194cbca182f2e226522ad9)` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:37.236572 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7631d612-91ea-4314-9fbe-2ec4d623b642 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:37.238823 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 130/264] 10.222.0.62 () {56 vars in 1177 bytes} [Fri May 27 08:26:37 2022] GET /identity/v3/users/1d53a0c91b194cbca182f2e226522ad9 => generated 283 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 08:26:37.244543 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7631d612-91ea-4314-9fbe-2ec4d623b642 None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:37.316453 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea8159f-6e17-4b1b-a37e-2b145bdcc711 None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:37.336691 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:37.398306 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc24b557-3e06-4d22-b3e5-a78f0ad95587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:37.399188 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc24b557-3e06-4d22-b3e5-a78f0ad95587 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:37.399471 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc24b557-3e06-4d22-b3e5-a78f0ad95587 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:37.399741 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc24b557-3e06-4d22-b3e5-a78f0ad95587 None admin] PATH_INFO: `/v3/projects/7086655a913e49b899fae73f13ec6c42` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:37.405471 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc24b557-3e06-4d22-b3e5-a78f0ad95587 None admin] RBAC: Authorizing `identity:get_project(project_id=7086655a913e49b899fae73f13ec6c42)` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:37.406974 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc24b557-3e06-4d22-b3e5-a78f0ad95587 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:37.408970 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 135/265] 10.222.0.62 () {56 vars in 1186 bytes} [Fri May 27 08:26:37 2022] GET /identity/v3/projects/7086655a913e49b899fae73f13ec6c42 => generated 302 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 08:26:37.415632 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc24b557-3e06-4d22-b3e5-a78f0ad95587 None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:37.514852 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7631d612-91ea-4314-9fbe-2ec4d623b642 None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:37.597684 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af30171-bb7b-436e-b969-2ed31c978d76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:37.598291 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af30171-bb7b-436e-b969-2ed31c978d76 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:37.598583 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af30171-bb7b-436e-b969-2ed31c978d76 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:37.598864 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af30171-bb7b-436e-b969-2ed31c978d76 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:37.615548 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc24b557-3e06-4d22-b3e5-a78f0ad95587 None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:37.706732 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4977a468-cd6c-49a5-b130-28b1a25848a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:37.708046 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4977a468-cd6c-49a5-b130-28b1a25848a3 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:37.708326 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4977a468-cd6c-49a5-b130-28b1a25848a3 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:37.708615 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4977a468-cd6c-49a5-b130-28b1a25848a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:37.709461 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4977a468-cd6c-49a5-b130-28b1a25848a3 None admin] RBAC: Adding query filter params (role.id=5e6f243a7201412c965e7c70249d4dc0, scope.project.id=7086655a913e49b899fae73f13ec6c42, user.id=1d53a0c91b194cbca182f2e226522ad9) {{(pid=87173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:26:37.709777 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4977a468-cd6c-49a5-b130-28b1a25848a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:37.711274 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4977a468-cd6c-49a5-b130-28b1a25848a3 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:37.725781 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 136/266] 10.222.0.62 () {56 vars in 1374 bytes} [Fri May 27 08:26:37 2022] GET /identity/v3/role_assignments?user.id=1d53a0c91b194cbca182f2e226522ad9&scope.project.id=7086655a913e49b899fae73f13ec6c42&role.id=5e6f243a7201412c965e7c70249d4dc0 => generated 608 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 08:26:37.747913 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:37.754907 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af30171-bb7b-436e-b969-2ed31c978d76 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:37.756417 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af30171-bb7b-436e-b969-2ed31c978d76 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:37.826486 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6406c03-5d4e-4531-b555-ae34da5aaa88 None None] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:37.826814 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6406c03-5d4e-4531-b555-ae34da5aaa88 None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:37.827060 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6406c03-5d4e-4531-b555-ae34da5aaa88 None None] PATH_INFO: `/` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:37.828723 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 137/267] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:26:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 08:26:37.842159 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb346c78-154c-4b8e-bb6e-61e8072f7b59 None None] REQUEST_METHOD: `POST` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:37.842490 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb346c78-154c-4b8e-bb6e-61e8072f7b59 None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:37.842729 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb346c78-154c-4b8e-bb6e-61e8072f7b59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:37.873892 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.auth.core [None req-fb346c78-154c-4b8e-bb6e-61e8072f7b59 None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:26:37.875078 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.fernet_utils [None req-fb346c78-154c-4b8e-bb6e-61e8072f7b59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:26:37.957752 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 131/268] 10.222.0.62 () {58 vars in 1282 bytes} [Fri May 27 08:26:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 714 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 27 08:26:37.964653 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af30171-bb7b-436e-b969-2ed31c978d76 None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:37.964833 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:38.083103 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 138/269] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:26:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 08:26:38.121930 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb346c78-154c-4b8e-bb6e-61e8072f7b59 None None] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:38.125177 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:38.135938 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af30171-bb7b-436e-b969-2ed31c978d76 None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:38.189533 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30587868-6fcb-4dc7-a560-fc2fc5d39fbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:38.190409 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30587868-6fcb-4dc7-a560-fc2fc5d39fbd None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:38.190693 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30587868-6fcb-4dc7-a560-fc2fc5d39fbd None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:38.190970 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30587868-6fcb-4dc7-a560-fc2fc5d39fbd None admin] PATH_INFO: `/v3/projects/7086655a913e49b899fae73f13ec6c42` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:38.197626 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30587868-6fcb-4dc7-a560-fc2fc5d39fbd None admin] RBAC: Authorizing `identity:get_project(project_id=7086655a913e49b899fae73f13ec6c42)` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:38.199153 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30587868-6fcb-4dc7-a560-fc2fc5d39fbd None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:38.201382 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 132/270] 10.222.0.62 () {56 vars in 1186 bytes} [Fri May 27 08:26:37 2022] GET /identity/v3/projects/7086655a913e49b899fae73f13ec6c42 => generated 302 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 08:26:38.207398 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30587868-6fcb-4dc7-a560-fc2fc5d39fbd None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:38.287758 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb346c78-154c-4b8e-bb6e-61e8072f7b59 None None] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:38.328116 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4026d64-8825-42db-8347-e732af7214cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:38.328974 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4026d64-8825-42db-8347-e732af7214cc None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:38.329262 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4026d64-8825-42db-8347-e732af7214cc None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:38.329543 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4026d64-8825-42db-8347-e732af7214cc None admin] PATH_INFO: `/v3/roles/member` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:38.343797 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30587868-6fcb-4dc7-a560-fc2fc5d39fbd None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:38.344397 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4026d64-8825-42db-8347-e732af7214cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 08:26:38.353198 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application [None req-d4026d64-8825-42db-8347-e732af7214cc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 08:26:38.353198 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:26:38.353198 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:26:38.353198 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:26:38.353198 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:26:38.353198 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:26:38.353198 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:26:38.353198 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:26:38.353198 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:26:38.353198 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:26:38.353198 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:26:38.353198 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:26:38.353198 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 08:26:38.353198 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 08:26:38.353198 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 08:26:38.353198 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 08:26:38.354141 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 08:26:38.354141 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 08:26:38.354141 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 08:26:38.354141 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 08:26:38.354141 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:26:38.354141 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:26:38.354141 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:26:38.354141 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:26:38.354141 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:26:38.354141 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:26:38.354141 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:26:38.354141 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application with Lock( May 27 08:26:38.354141 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:26:38.354141 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._enter() May 27 08:26:38.354141 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:26:38.354141 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:26:38.354922 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:26:38.354922 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.creator() May 27 08:26:38.354922 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:26:38.354922 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application created_value = creator( May 27 08:26:38.354922 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 08:26:38.354922 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 08:26:38.354922 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 08:26:38.354922 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 08:26:38.354922 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 08:26:38.354922 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 08:26:38.354922 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 08:26:38.354922 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application May 27 08:26:38.354922 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 139/271] 10.222.0.62 () {56 vars in 1099 bytes} [Fri May 27 08:26:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 08:26:38.357147 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd89b1bc-72c9-4b9e-bbff-dcd757b2656a None None] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:38.357147 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd89b1bc-72c9-4b9e-bbff-dcd757b2656a None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:38.357147 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd89b1bc-72c9-4b9e-bbff-dcd757b2656a None None] PATH_INFO: `/` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:38.361268 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 140/272] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:26:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:26:38.363091 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd89b1bc-72c9-4b9e-bbff-dcd757b2656a None None] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:38.395328 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda3ec91-4238-49ed-8855-3bb31610fe88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:38.396164 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda3ec91-4238-49ed-8855-3bb31610fe88 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:38.396641 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda3ec91-4238-49ed-8855-3bb31610fe88 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:38.396926 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda3ec91-4238-49ed-8855-3bb31610fe88 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:38.397454 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:38.398112 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda3ec91-4238-49ed-8855-3bb31610fe88 None admin] RBAC: Adding query filter params (role.id=9ff71fb5e7b7407d8d243eaa7da0a125, scope.project.id=7086655a913e49b899fae73f13ec6c42, user.id=1d53a0c91b194cbca182f2e226522ad9) {{(pid=87172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:26:38.398444 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda3ec91-4238-49ed-8855-3bb31610fe88 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:38.400680 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda3ec91-4238-49ed-8855-3bb31610fe88 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:38.412786 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 133/273] 10.222.0.62 () {56 vars in 1374 bytes} [Fri May 27 08:26:38 2022] GET /identity/v3/role_assignments?user.id=1d53a0c91b194cbca182f2e226522ad9&scope.project.id=7086655a913e49b899fae73f13ec6c42&role.id=9ff71fb5e7b7407d8d243eaa7da0a125 => generated 608 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 08:26:38.417072 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b1cc5b-97c4-4e2a-87e4-3582cfdc00e7 None None] REQUEST_METHOD: `POST` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:38.417365 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b1cc5b-97c4-4e2a-87e4-3582cfdc00e7 None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:38.417650 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b1cc5b-97c4-4e2a-87e4-3582cfdc00e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:38.466477 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.auth.core [None req-08b1cc5b-97c4-4e2a-87e4-3582cfdc00e7 None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:26:38.469268 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.fernet_utils [None req-08b1cc5b-97c4-4e2a-87e4-3582cfdc00e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:26:38.516946 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd89b1bc-72c9-4b9e-bbff-dcd757b2656a None None] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:38.537265 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:38.600363 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2cec51-2bcd-4980-a783-c4c3c6fb256e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:38.601168 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2cec51-2bcd-4980-a783-c4c3c6fb256e None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:38.601764 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2cec51-2bcd-4980-a783-c4c3c6fb256e None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:38.602076 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2cec51-2bcd-4980-a783-c4c3c6fb256e None admin] PATH_INFO: `/v3/roles` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:38.604993 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2cec51-2bcd-4980-a783-c4c3c6fb256e None admin] RBAC: Adding query filter params (name=member) {{(pid=87173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:26:38.605310 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2cec51-2bcd-4980-a783-c4c3c6fb256e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:38.608109 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2cec51-2bcd-4980-a783-c4c3c6fb256e None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:38.622805 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 141/274] 10.222.0.62 () {56 vars in 1101 bytes} [Fri May 27 08:26:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:26:38.629584 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2cec51-2bcd-4980-a783-c4c3c6fb256e None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:38.658979 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 134/275] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:26:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 08:26:38.695223 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b1cc5b-97c4-4e2a-87e4-3582cfdc00e7 None None] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:38.777108 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:38.792846 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2cec51-2bcd-4980-a783-c4c3c6fb256e None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:38.830273 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b1cc5b-97c4-4e2a-87e4-3582cfdc00e7 None None] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:38.849543 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfcd925-5dae-48c3-a259-403063c75ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:38.850817 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfcd925-5dae-48c3-a259-403063c75ea9 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:38.851319 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfcd925-5dae-48c3-a259-403063c75ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:38.851803 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfcd925-5dae-48c3-a259-403063c75ea9 None admin] PATH_INFO: `/v3/users/8641c266d9024a668e8a89a15d1cce7a` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:38.874123 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfcd925-5dae-48c3-a259-403063c75ea9 None admin] RBAC: Authorizing `identity:get_user(user_id=8641c266d9024a668e8a89a15d1cce7a)` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:38.875745 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffee0945-bd21-489c-85c5-d21cac5bda16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:38.876081 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfcd925-5dae-48c3-a259-403063c75ea9 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:38.876813 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffee0945-bd21-489c-85c5-d21cac5bda16 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:38.877097 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffee0945-bd21-489c-85c5-d21cac5bda16 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:38.877373 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffee0945-bd21-489c-85c5-d21cac5bda16 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:38.878691 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffee0945-bd21-489c-85c5-d21cac5bda16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:38.879035 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 142/276] 10.222.0.62 () {56 vars in 1177 bytes} [Fri May 27 08:26:38 2022] GET /identity/v3/users/8641c266d9024a668e8a89a15d1cce7a => generated 293 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:26:38.880297 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffee0945-bd21-489c-85c5-d21cac5bda16 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:38.882165 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 135/277] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 08:26:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 08:26:38.886727 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfcd925-5dae-48c3-a259-403063c75ea9 None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:38.889440 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffee0945-bd21-489c-85c5-d21cac5bda16 None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:38.923956 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:39.028371 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffee0945-bd21-489c-85c5-d21cac5bda16 None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:39.039122 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfcd925-5dae-48c3-a259-403063c75ea9 None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:39.068658 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895c0be3-9510-424e-b487-797e4aca8bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:39.069460 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895c0be3-9510-424e-b487-797e4aca8bbc None admin] REQUEST_METHOD: `POST` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:39.069775 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895c0be3-9510-424e-b487-797e4aca8bbc None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:39.070056 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895c0be3-9510-424e-b487-797e4aca8bbc None admin] PATH_INFO: `/v3/users` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:39.070971 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895c0be3-9510-424e-b487-797e4aca8bbc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:39.072686 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895c0be3-9510-424e-b487-797e4aca8bbc None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:39.080916 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0d45ab-4fff-4866-b5a9-4df9a61fc1fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:39.082848 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0d45ab-4fff-4866-b5a9-4df9a61fc1fc None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:39.083362 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0d45ab-4fff-4866-b5a9-4df9a61fc1fc None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:39.084375 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0d45ab-4fff-4866-b5a9-4df9a61fc1fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:39.085627 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0d45ab-4fff-4866-b5a9-4df9a61fc1fc None admin] RBAC: Adding query filter params (role.id=c980c64bb84b418daa012ae45a054b37, user.id=8641c266d9024a668e8a89a15d1cce7a, scope.system=all) {{(pid=87173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:26:39.085914 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0d45ab-4fff-4866-b5a9-4df9a61fc1fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:39.087663 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0d45ab-4fff-4866-b5a9-4df9a61fc1fc None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:39.094422 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 143/278] 10.222.0.62 () {56 vars in 1308 bytes} [Fri May 27 08:26:38 2022] GET /identity/v3/role_assignments?user.id=8641c266d9024a668e8a89a15d1cce7a&scope.system=all&role.id=c980c64bb84b418daa012ae45a054b37 => generated 226 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:26:39.097373 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 136/279] 10.222.0.62 () {60 vars in 1132 bytes} [Fri May 27 08:26:38 2022] POST /identity/v3/users => generated 293 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 08:26:39.430663 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3340d22-653a-4177-902b-adb07d947046 None None] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:39.431129 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3340d22-653a-4177-902b-adb07d947046 None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:39.431309 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3340d22-653a-4177-902b-adb07d947046 None None] PATH_INFO: `/` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:39.432639 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 144/280] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:26:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:26:39.438673 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70665d20-d93a-4051-a14e-503dc90678c2 None None] REQUEST_METHOD: `POST` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:39.439146 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70665d20-d93a-4051-a14e-503dc90678c2 None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:39.439242 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70665d20-d93a-4051-a14e-503dc90678c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:39.462291 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.auth.core [None req-70665d20-d93a-4051-a14e-503dc90678c2 None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:26:39.463605 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.fernet_utils [None req-70665d20-d93a-4051-a14e-503dc90678c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:26:39.559609 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 137/281] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:26:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 08:26:39.589811 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3340d22-653a-4177-902b-adb07d947046 None None] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:39.606030 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:39.715774 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3340d22-653a-4177-902b-adb07d947046 None None] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:39.721155 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fab112-0385-4416-8ca1-9619b5dddbeb None None] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:39.721437 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fab112-0385-4416-8ca1-9619b5dddbeb None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:39.721719 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fab112-0385-4416-8ca1-9619b5dddbeb None None] PATH_INFO: `/` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:39.724254 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 138/282] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:26:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:26:39.729604 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615a38cb-5b36-41ee-86e2-12f09f1c2464 None None] REQUEST_METHOD: `POST` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:39.729911 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615a38cb-5b36-41ee-86e2-12f09f1c2464 None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:39.730162 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615a38cb-5b36-41ee-86e2-12f09f1c2464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:39.757674 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.auth.core [None req-615a38cb-5b36-41ee-86e2-12f09f1c2464 None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:26:39.759229 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.fernet_utils [None req-615a38cb-5b36-41ee-86e2-12f09f1c2464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:26:39.761360 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9abcaef-4832-402e-a296-85cf40092a4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:39.764439 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9abcaef-4832-402e-a296-85cf40092a4b None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:39.764439 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9abcaef-4832-402e-a296-85cf40092a4b None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:39.764439 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9abcaef-4832-402e-a296-85cf40092a4b None admin] PATH_INFO: `/v3/roles/member` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:39.771563 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:39.774650 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9abcaef-4832-402e-a296-85cf40092a4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 08:26:39.782856 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application [None req-b9abcaef-4832-402e-a296-85cf40092a4b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 08:26:39.782856 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:26:39.782856 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:26:39.782856 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:26:39.782856 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:26:39.782856 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:26:39.782856 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:26:39.782856 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:26:39.782856 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:26:39.782856 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:26:39.782856 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:26:39.782856 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:26:39.782856 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 08:26:39.782856 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 08:26:39.782856 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 08:26:39.782856 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 08:26:39.783827 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 08:26:39.783827 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 08:26:39.783827 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 08:26:39.783827 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 08:26:39.783827 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:26:39.783827 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:26:39.783827 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:26:39.783827 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:26:39.783827 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:26:39.783827 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:26:39.783827 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:26:39.783827 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application with Lock( May 27 08:26:39.783827 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:26:39.783827 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._enter() May 27 08:26:39.783827 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:26:39.783827 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:26:39.785149 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:26:39.785149 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.creator() May 27 08:26:39.785149 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:26:39.785149 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application created_value = creator( May 27 08:26:39.785149 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 08:26:39.785149 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 08:26:39.785149 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 08:26:39.785149 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 08:26:39.785149 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 08:26:39.785149 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 08:26:39.785149 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 08:26:39.785149 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application May 27 08:26:39.785149 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 145/283] 10.222.0.62 () {56 vars in 1099 bytes} [Fri May 27 08:26:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 08:26:39.790785 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9abcaef-4832-402e-a296-85cf40092a4b None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:39.894475 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 139/284] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:26:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 08:26:39.921554 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615a38cb-5b36-41ee-86e2-12f09f1c2464 None None] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:39.930714 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:40.049443 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615a38cb-5b36-41ee-86e2-12f09f1c2464 None None] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:40.053005 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9abcaef-4832-402e-a296-85cf40092a4b None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:40.090161 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accb1dfd-b519-4a51-b069-91637e171960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:40.090970 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accb1dfd-b519-4a51-b069-91637e171960 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:40.091252 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accb1dfd-b519-4a51-b069-91637e171960 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:40.091523 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accb1dfd-b519-4a51-b069-91637e171960 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:40.102453 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:40.106739 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accb1dfd-b519-4a51-b069-91637e171960 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 08:26:40.119761 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application [None req-accb1dfd-b519-4a51-b069-91637e171960 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 27 08:26:40.119761 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:26:40.119761 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:26:40.119761 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:26:40.119761 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:26:40.119761 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:26:40.119761 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:26:40.119761 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:26:40.119761 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:26:40.119761 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:26:40.119761 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:26:40.119761 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:26:40.119761 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 08:26:40.119761 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 08:26:40.119761 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 08:26:40.119761 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 08:26:40.120752 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 08:26:40.120752 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 08:26:40.120752 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 08:26:40.120752 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 08:26:40.120752 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:26:40.120752 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:26:40.120752 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:26:40.120752 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:26:40.120752 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:26:40.120752 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:26:40.120752 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:26:40.120752 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application with Lock( May 27 08:26:40.120752 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:26:40.120752 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._enter() May 27 08:26:40.120752 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:26:40.120752 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:26:40.121993 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:26:40.121993 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.creator() May 27 08:26:40.121993 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:26:40.121993 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application created_value = creator( May 27 08:26:40.121993 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 08:26:40.121993 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 08:26:40.121993 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 08:26:40.121993 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 08:26:40.121993 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 08:26:40.121993 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 08:26:40.121993 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 27 08:26:40.121993 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application May 27 08:26:40.121993 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 140/285] 10.222.0.62 () {56 vars in 1099 bytes} [Fri May 27 08:26:39 2022] GET /identity/v3/roles/reader => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 08:26:40.127797 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accb1dfd-b519-4a51-b069-91637e171960 None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:40.158543 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa53038a-3ffd-4a11-80ba-98e95e5cde51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:40.159219 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa53038a-3ffd-4a11-80ba-98e95e5cde51 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:40.159499 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa53038a-3ffd-4a11-80ba-98e95e5cde51 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:40.160322 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa53038a-3ffd-4a11-80ba-98e95e5cde51 None admin] PATH_INFO: `/v3/roles` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:40.162714 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa53038a-3ffd-4a11-80ba-98e95e5cde51 None admin] RBAC: Adding query filter params (name=member) {{(pid=87173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:26:40.162714 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa53038a-3ffd-4a11-80ba-98e95e5cde51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:40.163318 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa53038a-3ffd-4a11-80ba-98e95e5cde51 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:40.195206 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 146/286] 10.222.0.62 () {56 vars in 1101 bytes} [Fri May 27 08:26:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 405 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 08:26:40.202470 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa53038a-3ffd-4a11-80ba-98e95e5cde51 None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:40.268723 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accb1dfd-b519-4a51-b069-91637e171960 None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:40.313271 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d3047b-14e2-45ea-9159-e60759fa389a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:40.314420 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d3047b-14e2-45ea-9159-e60759fa389a None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:40.314941 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d3047b-14e2-45ea-9159-e60759fa389a None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:40.315424 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d3047b-14e2-45ea-9159-e60759fa389a None admin] PATH_INFO: `/v3/roles` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:40.316614 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d3047b-14e2-45ea-9159-e60759fa389a None admin] RBAC: Adding query filter params (name=reader) {{(pid=87172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:26:40.317393 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d3047b-14e2-45ea-9159-e60759fa389a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:40.319337 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d3047b-14e2-45ea-9159-e60759fa389a None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:40.330387 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 141/287] 10.222.0.62 () {56 vars in 1101 bytes} [Fri May 27 08:26:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 08:26:40.339106 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d3047b-14e2-45ea-9159-e60759fa389a None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:40.418081 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:40.451789 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa53038a-3ffd-4a11-80ba-98e95e5cde51 None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:40.466876 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d3047b-14e2-45ea-9159-e60759fa389a None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:40.508890 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978b24cb-d461-427a-9ed3-88dc6d886d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:40.510383 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978b24cb-d461-427a-9ed3-88dc6d886d66 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:40.510875 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978b24cb-d461-427a-9ed3-88dc6d886d66 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:40.511354 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978b24cb-d461-427a-9ed3-88dc6d886d66 None admin] PATH_INFO: `/v3/users/4f1cc13b7189408f8d266885ec60d9eb` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:40.513031 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978b24cb-d461-427a-9ed3-88dc6d886d66 None admin] RBAC: Authorizing `identity:get_user(user_id=4f1cc13b7189408f8d266885ec60d9eb)` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:40.515059 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978b24cb-d461-427a-9ed3-88dc6d886d66 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:40.517005 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 142/288] 10.222.0.62 () {56 vars in 1177 bytes} [Fri May 27 08:26:40 2022] GET /identity/v3/users/4f1cc13b7189408f8d266885ec60d9eb => generated 297 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 08:26:40.524492 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978b24cb-d461-427a-9ed3-88dc6d886d66 None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:40.585993 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db50a5f-f16c-4ee0-ba0c-99223205403d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:40.586779 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db50a5f-f16c-4ee0-ba0c-99223205403d None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:40.587059 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db50a5f-f16c-4ee0-ba0c-99223205403d None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:40.587333 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db50a5f-f16c-4ee0-ba0c-99223205403d None admin] PATH_INFO: `/v3/users/a488d5a3047046b18d9aecffcf353431` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:40.593462 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db50a5f-f16c-4ee0-ba0c-99223205403d None admin] RBAC: Authorizing `identity:get_user(user_id=a488d5a3047046b18d9aecffcf353431)` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:40.594883 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db50a5f-f16c-4ee0-ba0c-99223205403d None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:40.596852 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 147/289] 10.222.0.62 () {56 vars in 1177 bytes} [Fri May 27 08:26:40 2022] GET /identity/v3/users/a488d5a3047046b18d9aecffcf353431 => generated 297 bytes in 395 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 08:26:40.609540 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db50a5f-f16c-4ee0-ba0c-99223205403d None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:40.615290 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:40.675447 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978b24cb-d461-427a-9ed3-88dc6d886d66 None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:40.748001 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:40.755745 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cd767b-dc87-4d60-be9f-71a9acc7fe9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:40.756651 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cd767b-dc87-4d60-be9f-71a9acc7fe9f None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:40.756942 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cd767b-dc87-4d60-be9f-71a9acc7fe9f None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:40.757222 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cd767b-dc87-4d60-be9f-71a9acc7fe9f None admin] PATH_INFO: `/v3/projects/7086655a913e49b899fae73f13ec6c42` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:40.761580 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cd767b-dc87-4d60-be9f-71a9acc7fe9f None admin] RBAC: Authorizing `identity:get_project(project_id=7086655a913e49b899fae73f13ec6c42)` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:40.763056 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cd767b-dc87-4d60-be9f-71a9acc7fe9f None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:40.770767 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 143/290] 10.222.0.62 () {56 vars in 1186 bytes} [Fri May 27 08:26:40 2022] GET /identity/v3/projects/7086655a913e49b899fae73f13ec6c42 => generated 302 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:26:40.771593 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cd767b-dc87-4d60-be9f-71a9acc7fe9f None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:40.839663 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db50a5f-f16c-4ee0-ba0c-99223205403d None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:40.916568 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cd767b-dc87-4d60-be9f-71a9acc7fe9f None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:40.918229 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e49f80-c645-4310-b1ae-4abcac635347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:40.919157 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e49f80-c645-4310-b1ae-4abcac635347 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:40.919651 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e49f80-c645-4310-b1ae-4abcac635347 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:40.920131 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e49f80-c645-4310-b1ae-4abcac635347 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:40.957497 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115a763c-7543-4c38-b7c9-c8a8b144db74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:40.960187 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115a763c-7543-4c38-b7c9-c8a8b144db74 None admin] REQUEST_METHOD: `PUT` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:40.960187 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115a763c-7543-4c38-b7c9-c8a8b144db74 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:40.960187 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115a763c-7543-4c38-b7c9-c8a8b144db74 None admin] PATH_INFO: `/v3/projects/7086655a913e49b899fae73f13ec6c42/users/4f1cc13b7189408f8d266885ec60d9eb/roles/279cf625eaed4bac893add184f558fd1` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:40.962051 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115a763c-7543-4c38-b7c9-c8a8b144db74 None admin] RBAC: Authorizing `identity:create_grant(project_id=7086655a913e49b899fae73f13ec6c42, user_id=4f1cc13b7189408f8d266885ec60d9eb, role_id=279cf625eaed4bac893add184f558fd1)` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:40.963975 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115a763c-7543-4c38-b7c9-c8a8b144db74 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:40.990189 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 144/291] 10.222.0.62 () {58 vars in 1439 bytes} [Fri May 27 08:26:40 2022] PUT /identity/v3/projects/7086655a913e49b899fae73f13ec6c42/users/4f1cc13b7189408f8d266885ec60d9eb/roles/279cf625eaed4bac893add184f558fd1 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 08:26:41.081039 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e49f80-c645-4310-b1ae-4abcac635347 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:41.083541 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e49f80-c645-4310-b1ae-4abcac635347 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:41.088616 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:41.232012 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 148/292] 10.222.0.62 () {58 vars in 1282 bytes} [Fri May 27 08:26:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 623 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 08:26:41.239323 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115a763c-7543-4c38-b7c9-c8a8b144db74 None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:41.339346 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:41.391117 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115a763c-7543-4c38-b7c9-c8a8b144db74 None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:41.430201 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed1423a-5063-4d93-b3d4-2e187ef15504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:41.431073 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed1423a-5063-4d93-b3d4-2e187ef15504 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:41.431357 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed1423a-5063-4d93-b3d4-2e187ef15504 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:41.431632 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed1423a-5063-4d93-b3d4-2e187ef15504 None admin] PATH_INFO: `/v3/projects/7086655a913e49b899fae73f13ec6c42` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:41.432879 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed1423a-5063-4d93-b3d4-2e187ef15504 None admin] RBAC: Authorizing `identity:get_project(project_id=7086655a913e49b899fae73f13ec6c42)` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:41.434344 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed1423a-5063-4d93-b3d4-2e187ef15504 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:41.436067 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 145/293] 10.222.0.62 () {56 vars in 1186 bytes} [Fri May 27 08:26:41 2022] GET /identity/v3/projects/7086655a913e49b899fae73f13ec6c42 => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:26:41.442741 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e49f80-c645-4310-b1ae-4abcac635347 None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:41.555028 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e49f80-c645-4310-b1ae-4abcac635347 None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:41.556558 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:41.592559 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eea2ceb-6adf-46f5-9b9d-bacd572ee30a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:41.593256 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eea2ceb-6adf-46f5-9b9d-bacd572ee30a None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:41.593679 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eea2ceb-6adf-46f5-9b9d-bacd572ee30a None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:41.593956 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eea2ceb-6adf-46f5-9b9d-bacd572ee30a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:41.594795 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eea2ceb-6adf-46f5-9b9d-bacd572ee30a None admin] RBAC: Adding query filter params (role.id=c980c64bb84b418daa012ae45a054b37, scope.project.id=7086655a913e49b899fae73f13ec6c42, user.id=a488d5a3047046b18d9aecffcf353431) {{(pid=87173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:26:41.595105 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eea2ceb-6adf-46f5-9b9d-bacd572ee30a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:41.596564 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eea2ceb-6adf-46f5-9b9d-bacd572ee30a None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:41.604207 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 149/294] 10.222.0.62 () {56 vars in 1374 bytes} [Fri May 27 08:26:41 2022] GET /identity/v3/role_assignments?user.id=a488d5a3047046b18d9aecffcf353431&scope.project.id=7086655a913e49b899fae73f13ec6c42&role.id=c980c64bb84b418daa012ae45a054b37 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:26:41.686934 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aecf874-1e3d-4d94-8585-d3e7bc40870e None None] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:41.687441 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aecf874-1e3d-4d94-8585-d3e7bc40870e None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:41.687515 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aecf874-1e3d-4d94-8585-d3e7bc40870e None None] PATH_INFO: `/` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:41.689028 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 146/295] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:26:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:26:41.695655 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bef7ac-ce2f-4b3e-8971-8f1930991b92 None None] REQUEST_METHOD: `POST` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:41.695968 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bef7ac-ce2f-4b3e-8971-8f1930991b92 None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:41.696223 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bef7ac-ce2f-4b3e-8971-8f1930991b92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:41.719502 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.auth.core [None req-13bef7ac-ce2f-4b3e-8971-8f1930991b92 None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:26:41.720762 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.fernet_utils [None req-13bef7ac-ce2f-4b3e-8971-8f1930991b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:26:41.798462 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 150/296] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:26:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 08:26:41.843575 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aecf874-1e3d-4d94-8585-d3e7bc40870e None None] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:41.969419 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aecf874-1e3d-4d94-8585-d3e7bc40870e None None] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:41.999481 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:42.013930 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcc1a8f-7de6-469c-8cdf-db101c3cd551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:42.014730 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcc1a8f-7de6-469c-8cdf-db101c3cd551 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:42.015014 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcc1a8f-7de6-469c-8cdf-db101c3cd551 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:42.015287 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcc1a8f-7de6-469c-8cdf-db101c3cd551 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:42.028312 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcc1a8f-7de6-469c-8cdf-db101c3cd551 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 08:26:42.039227 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application [None req-4dcc1a8f-7de6-469c-8cdf-db101c3cd551 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 08:26:42.039227 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:26:42.039227 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:26:42.039227 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:26:42.039227 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:26:42.039227 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:26:42.039227 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:26:42.039227 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:26:42.039227 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:26:42.039227 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:26:42.039227 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:26:42.039227 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:26:42.039227 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 08:26:42.039227 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 08:26:42.039227 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 08:26:42.039227 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 08:26:42.040220 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 08:26:42.040220 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 08:26:42.040220 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 08:26:42.040220 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 08:26:42.040220 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:26:42.040220 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:26:42.040220 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:26:42.040220 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:26:42.040220 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:26:42.040220 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:26:42.040220 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:26:42.040220 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application with Lock( May 27 08:26:42.040220 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:26:42.040220 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._enter() May 27 08:26:42.040220 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:26:42.040220 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:26:42.041210 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:26:42.041210 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.creator() May 27 08:26:42.041210 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:26:42.041210 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application created_value = creator( May 27 08:26:42.041210 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 08:26:42.041210 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 08:26:42.041210 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 08:26:42.041210 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 08:26:42.041210 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 08:26:42.041210 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 08:26:42.041210 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 08:26:42.041210 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application May 27 08:26:42.041210 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 147/297] 10.222.0.62 () {56 vars in 1099 bytes} [Fri May 27 08:26:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 08:26:42.051444 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bef7ac-ce2f-4b3e-8971-8f1930991b92 None None] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:42.199977 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bef7ac-ce2f-4b3e-8971-8f1930991b92 None None] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:42.201818 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:42.242721 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1cb92a-14b7-4d90-aea1-ad640b7ab701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:42.243497 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1cb92a-14b7-4d90-aea1-ad640b7ab701 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:42.243702 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1cb92a-14b7-4d90-aea1-ad640b7ab701 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:42.243956 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1cb92a-14b7-4d90-aea1-ad640b7ab701 None admin] PATH_INFO: `/v3/roles` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:42.244800 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1cb92a-14b7-4d90-aea1-ad640b7ab701 None admin] RBAC: Adding query filter params (name=member) {{(pid=87173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:26:42.245115 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1cb92a-14b7-4d90-aea1-ad640b7ab701 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:42.246684 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1cb92a-14b7-4d90-aea1-ad640b7ab701 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:42.258256 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 151/298] 10.222.0.62 () {56 vars in 1101 bytes} [Fri May 27 08:26:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:26:42.265187 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcc1a8f-7de6-469c-8cdf-db101c3cd551 None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:42.271940 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc2fe43-7f02-41a5-82e4-307f66db9911 None None] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:42.272581 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc2fe43-7f02-41a5-82e4-307f66db9911 None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:42.273141 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc2fe43-7f02-41a5-82e4-307f66db9911 None None] PATH_INFO: `/` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:42.275148 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 152/299] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:26:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:26:42.281065 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a301859b-6706-4a5c-b7bc-3c472db09b99 None None] REQUEST_METHOD: `POST` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:42.281759 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a301859b-6706-4a5c-b7bc-3c472db09b99 None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:42.282239 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a301859b-6706-4a5c-b7bc-3c472db09b99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:42.301888 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.auth.core [None req-a301859b-6706-4a5c-b7bc-3c472db09b99 None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:26:42.304126 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.fernet_utils [None req-a301859b-6706-4a5c-b7bc-3c472db09b99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:26:42.392876 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 153/300] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:26:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 08:26:42.398605 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcc1a8f-7de6-469c-8cdf-db101c3cd551 None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:42.414836 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a301859b-6706-4a5c-b7bc-3c472db09b99 None None] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:42.442079 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb70c5c1-342a-4a40-80ae-0594cffba285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:42.443003 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb70c5c1-342a-4a40-80ae-0594cffba285 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:42.443244 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb70c5c1-342a-4a40-80ae-0594cffba285 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:42.443545 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb70c5c1-342a-4a40-80ae-0594cffba285 None admin] PATH_INFO: `/v3/users/8641c266d9024a668e8a89a15d1cce7a` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:42.445067 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb70c5c1-342a-4a40-80ae-0594cffba285 None admin] RBAC: Authorizing `identity:get_user(user_id=8641c266d9024a668e8a89a15d1cce7a)` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:42.446804 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb70c5c1-342a-4a40-80ae-0594cffba285 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:42.448815 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 148/301] 10.222.0.62 () {56 vars in 1177 bytes} [Fri May 27 08:26:42 2022] GET /identity/v3/users/8641c266d9024a668e8a89a15d1cce7a => generated 293 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:26:42.454923 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb70c5c1-342a-4a40-80ae-0594cffba285 None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:42.515570 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:42.521245 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:42.529911 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a301859b-6706-4a5c-b7bc-3c472db09b99 None None] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:42.569229 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f618b6-2362-4ab1-818f-0a10b64b2363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:42.570131 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f618b6-2362-4ab1-818f-0a10b64b2363 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:42.570478 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f618b6-2362-4ab1-818f-0a10b64b2363 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:42.570820 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f618b6-2362-4ab1-818f-0a10b64b2363 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:42.570912 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb70c5c1-342a-4a40-80ae-0594cffba285 None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:42.583334 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f618b6-2362-4ab1-818f-0a10b64b2363 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 08:26:42.591173 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application [None req-f8f618b6-2362-4ab1-818f-0a10b64b2363 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 27 08:26:42.591173 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:26:42.591173 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:26:42.591173 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:26:42.591173 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:26:42.591173 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:26:42.591173 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:26:42.591173 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:26:42.591173 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:26:42.591173 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:26:42.591173 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:26:42.591173 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:26:42.591173 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 08:26:42.591173 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 08:26:42.591173 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 08:26:42.591173 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 08:26:42.592097 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 08:26:42.592097 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 08:26:42.592097 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 08:26:42.592097 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 08:26:42.592097 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:26:42.592097 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:26:42.592097 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:26:42.592097 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:26:42.592097 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:26:42.592097 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:26:42.592097 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:26:42.592097 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application with Lock( May 27 08:26:42.592097 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:26:42.592097 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._enter() May 27 08:26:42.592097 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:26:42.592097 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:26:42.599394 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:26:42.599394 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.creator() May 27 08:26:42.599394 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:26:42.599394 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application created_value = creator( May 27 08:26:42.599394 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 08:26:42.599394 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 08:26:42.599394 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 08:26:42.599394 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 08:26:42.599394 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 08:26:42.599394 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 08:26:42.599394 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 27 08:26:42.599394 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application May 27 08:26:42.599394 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 154/302] 10.222.0.62 () {56 vars in 1099 bytes} [Fri May 27 08:26:42 2022] GET /identity/v3/roles/reader => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 08:26:42.599394 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b076e441-637f-4fdb-b33d-bcf0bc713bd0 None None] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:42.600105 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b076e441-637f-4fdb-b33d-bcf0bc713bd0 None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:42.600105 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b076e441-637f-4fdb-b33d-bcf0bc713bd0 None None] PATH_INFO: `/` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:42.600105 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 155/303] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:26:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:26:42.600105 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b076e441-637f-4fdb-b33d-bcf0bc713bd0 None None] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:42.619800 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f15a632-8b9e-45f6-83de-87a1144de185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:42.621151 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f15a632-8b9e-45f6-83de-87a1144de185 None admin] REQUEST_METHOD: `PUT` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:42.621446 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f15a632-8b9e-45f6-83de-87a1144de185 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:42.621761 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f15a632-8b9e-45f6-83de-87a1144de185 None admin] PATH_INFO: `/v3/system/users/8641c266d9024a668e8a89a15d1cce7a/roles/c980c64bb84b418daa012ae45a054b37` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:42.623230 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f15a632-8b9e-45f6-83de-87a1144de185 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=8641c266d9024a668e8a89a15d1cce7a, role_id=c980c64bb84b418daa012ae45a054b37)` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:42.625408 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f15a632-8b9e-45f6-83de-87a1144de185 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:42.636800 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 149/304] 10.222.0.62 () {58 vars in 1334 bytes} [Fri May 27 08:26:42 2022] PUT /identity/v3/system/users/8641c266d9024a668e8a89a15d1cce7a/roles/c980c64bb84b418daa012ae45a054b37 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 08:26:42.638491 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bce471-382f-4316-bcd7-4e98bcce0b33 None None] REQUEST_METHOD: `POST` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:42.639139 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bce471-382f-4316-bcd7-4e98bcce0b33 None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:42.640233 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bce471-382f-4316-bcd7-4e98bcce0b33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:42.663647 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.auth.core [None req-b3bce471-382f-4316-bcd7-4e98bcce0b33 None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:26:42.665337 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.fernet_utils [None req-b3bce471-382f-4316-bcd7-4e98bcce0b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:26:42.749595 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b076e441-637f-4fdb-b33d-bcf0bc713bd0 None None] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:42.751549 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 150/305] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:26:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 08:26:42.782263 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bce471-382f-4316-bcd7-4e98bcce0b33 None None] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:42.802424 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b9a3c7-384c-44cc-92cb-0b5cb5dd37da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:42.803483 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b9a3c7-384c-44cc-92cb-0b5cb5dd37da None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:42.803944 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b9a3c7-384c-44cc-92cb-0b5cb5dd37da None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:42.804472 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b9a3c7-384c-44cc-92cb-0b5cb5dd37da None admin] PATH_INFO: `/v3/roles` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:42.805490 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b9a3c7-384c-44cc-92cb-0b5cb5dd37da None admin] RBAC: Adding query filter params (name=reader) {{(pid=87173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:26:42.805985 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b9a3c7-384c-44cc-92cb-0b5cb5dd37da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:42.807632 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b9a3c7-384c-44cc-92cb-0b5cb5dd37da None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:42.818427 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 156/306] 10.222.0.62 () {56 vars in 1101 bytes} [Fri May 27 08:26:42 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:26:42.824974 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b9a3c7-384c-44cc-92cb-0b5cb5dd37da None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:42.840337 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:42.856398 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:42.934143 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bce471-382f-4316-bcd7-4e98bcce0b33 None None] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:42.948938 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b9a3c7-384c-44cc-92cb-0b5cb5dd37da None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:42.983088 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657d6235-2c97-4623-ad6f-06efc202083a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:42.983979 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657d6235-2c97-4623-ad6f-06efc202083a None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:42.984329 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657d6235-2c97-4623-ad6f-06efc202083a None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:42.984731 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657d6235-2c97-4623-ad6f-06efc202083a None admin] PATH_INFO: `/v3/domains/default` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:42.986157 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657d6235-2c97-4623-ad6f-06efc202083a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:42.986360 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677e2629-3f8b-48b4-97dd-c1f414d4a56f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:42.987300 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677e2629-3f8b-48b4-97dd-c1f414d4a56f None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:42.987674 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677e2629-3f8b-48b4-97dd-c1f414d4a56f None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:42.988001 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657d6235-2c97-4623-ad6f-06efc202083a None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:42.988114 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677e2629-3f8b-48b4-97dd-c1f414d4a56f None admin] PATH_INFO: `/v3/users/5084ddf504d649d8bfad56a4aacd9674` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:42.992680 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 151/307] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 08:26:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 08:26:42.997376 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657d6235-2c97-4623-ad6f-06efc202083a None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:43.013934 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677e2629-3f8b-48b4-97dd-c1f414d4a56f None admin] RBAC: Authorizing `identity:get_user(user_id=5084ddf504d649d8bfad56a4aacd9674)` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:43.015380 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677e2629-3f8b-48b4-97dd-c1f414d4a56f None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:43.017466 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 157/308] 10.222.0.62 () {56 vars in 1177 bytes} [Fri May 27 08:26:42 2022] GET /identity/v3/users/5084ddf504d649d8bfad56a4aacd9674 => generated 293 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 08:26:43.023465 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677e2629-3f8b-48b4-97dd-c1f414d4a56f None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:43.097486 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:43.125474 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657d6235-2c97-4623-ad6f-06efc202083a None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:43.133456 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677e2629-3f8b-48b4-97dd-c1f414d4a56f None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:43.156996 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:43.168904 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51929074-a322-4cc2-959f-fce4bdb7bb40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:43.169936 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51929074-a322-4cc2-959f-fce4bdb7bb40 None admin] REQUEST_METHOD: `POST` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:43.170738 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51929074-a322-4cc2-959f-fce4bdb7bb40 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:43.171207 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51929074-a322-4cc2-959f-fce4bdb7bb40 None admin] PATH_INFO: `/v3/groups` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:43.172180 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51929074-a322-4cc2-959f-fce4bdb7bb40 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:43.173861 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51929074-a322-4cc2-959f-fce4bdb7bb40 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:43.174898 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70162e5-ef2b-4d3d-bca7-9b69051c3245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:43.175719 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70162e5-ef2b-4d3d-bca7-9b69051c3245 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:43.176157 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70162e5-ef2b-4d3d-bca7-9b69051c3245 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:43.176443 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70162e5-ef2b-4d3d-bca7-9b69051c3245 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:43.177344 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70162e5-ef2b-4d3d-bca7-9b69051c3245 None admin] RBAC: Adding query filter params (role.id=279cf625eaed4bac893add184f558fd1, user.id=5084ddf504d649d8bfad56a4aacd9674, scope.system=all) {{(pid=87173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:26:43.177659 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70162e5-ef2b-4d3d-bca7-9b69051c3245 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:43.179121 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70162e5-ef2b-4d3d-bca7-9b69051c3245 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:43.184891 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 158/309] 10.222.0.62 () {56 vars in 1308 bytes} [Fri May 27 08:26:43 2022] GET /identity/v3/role_assignments?user.id=5084ddf504d649d8bfad56a4aacd9674&scope.system=all&role.id=279cf625eaed4bac893add184f558fd1 => generated 226 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 08:26:43.194553 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 152/310] 10.222.0.62 () {60 vars in 1134 bytes} [Fri May 27 08:26:42 2022] POST /identity/v3/groups => generated 229 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 08:26:43.836209 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3411e24d-fbfc-49de-a756-48b275f7798d None None] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:43.836793 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3411e24d-fbfc-49de-a756-48b275f7798d None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:43.836793 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3411e24d-fbfc-49de-a756-48b275f7798d None None] PATH_INFO: `/` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:43.838164 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 159/311] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:26:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:26:43.843507 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599d2a0e-cb75-467b-8c38-992f6f39a2f7 None None] REQUEST_METHOD: `POST` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:43.843939 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599d2a0e-cb75-467b-8c38-992f6f39a2f7 None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:43.844090 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599d2a0e-cb75-467b-8c38-992f6f39a2f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:43.862622 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.auth.core [None req-599d2a0e-cb75-467b-8c38-992f6f39a2f7 None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:26:43.863874 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.fernet_utils [None req-599d2a0e-cb75-467b-8c38-992f6f39a2f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:26:43.944796 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 153/312] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:26:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 08:26:43.964109 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3411e24d-fbfc-49de-a756-48b275f7798d None None] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:44.090631 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3411e24d-fbfc-49de-a756-48b275f7798d None None] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:44.124461 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:44.131613 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3509f8-0616-4ab8-a6bd-93a771a72647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:44.132782 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3509f8-0616-4ab8-a6bd-93a771a72647 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:44.133278 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3509f8-0616-4ab8-a6bd-93a771a72647 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:44.133746 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3509f8-0616-4ab8-a6bd-93a771a72647 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:44.145493 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3509f8-0616-4ab8-a6bd-93a771a72647 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 08:26:44.155319 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application [None req-2c3509f8-0616-4ab8-a6bd-93a771a72647 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 27 08:26:44.155319 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:26:44.155319 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:26:44.155319 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:26:44.155319 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:26:44.155319 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:26:44.155319 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:26:44.155319 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:26:44.155319 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:26:44.155319 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:26:44.155319 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:26:44.155319 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:26:44.155319 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 08:26:44.155319 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 08:26:44.155319 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 08:26:44.155319 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 08:26:44.156283 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 08:26:44.156283 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 08:26:44.156283 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 08:26:44.156283 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 08:26:44.156283 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:26:44.156283 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:26:44.156283 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:26:44.156283 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:26:44.156283 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:26:44.156283 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:26:44.156283 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:26:44.156283 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application with Lock( May 27 08:26:44.156283 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:26:44.156283 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._enter() May 27 08:26:44.156283 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:26:44.156283 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:26:44.157152 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:26:44.157152 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.creator() May 27 08:26:44.157152 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:26:44.157152 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application created_value = creator( May 27 08:26:44.157152 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 08:26:44.157152 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 08:26:44.157152 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 08:26:44.157152 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 08:26:44.157152 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 08:26:44.157152 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 08:26:44.157152 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 27 08:26:44.157152 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application May 27 08:26:44.160064 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 160/313] 10.222.0.62 () {56 vars in 1099 bytes} [Fri May 27 08:26:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 08:26:44.165997 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599d2a0e-cb75-467b-8c38-992f6f39a2f7 None None] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:44.275700 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599d2a0e-cb75-467b-8c38-992f6f39a2f7 None None] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:44.283791 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:44.314791 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07197429-85f9-4ce0-b259-c743cf59021b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:44.315465 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07197429-85f9-4ce0-b259-c743cf59021b None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:44.316354 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07197429-85f9-4ce0-b259-c743cf59021b None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:44.316658 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07197429-85f9-4ce0-b259-c743cf59021b None admin] PATH_INFO: `/v3/roles` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:44.317422 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07197429-85f9-4ce0-b259-c743cf59021b None admin] RBAC: Adding query filter params (name=reader) {{(pid=87172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:26:44.317733 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07197429-85f9-4ce0-b259-c743cf59021b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:44.319129 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07197429-85f9-4ce0-b259-c743cf59021b None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:44.327758 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 154/314] 10.222.0.62 () {56 vars in 1101 bytes} [Fri May 27 08:26:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:26:44.333780 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3509f8-0616-4ab8-a6bd-93a771a72647 None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:44.445116 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3509f8-0616-4ab8-a6bd-93a771a72647 None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:44.486759 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53573738-916c-4d96-97bd-8048030ecd8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:44.488805 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53573738-916c-4d96-97bd-8048030ecd8e None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:44.489262 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53573738-916c-4d96-97bd-8048030ecd8e None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:44.489689 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53573738-916c-4d96-97bd-8048030ecd8e None admin] PATH_INFO: `/v3/users/4f1cc13b7189408f8d266885ec60d9eb` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:44.491109 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53573738-916c-4d96-97bd-8048030ecd8e None admin] RBAC: Authorizing `identity:get_user(user_id=4f1cc13b7189408f8d266885ec60d9eb)` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:44.492793 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53573738-916c-4d96-97bd-8048030ecd8e None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:44.494935 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 161/315] 10.222.0.62 () {56 vars in 1177 bytes} [Fri May 27 08:26:44 2022] GET /identity/v3/users/4f1cc13b7189408f8d266885ec60d9eb => generated 297 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:26:44.504613 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07197429-85f9-4ce0-b259-c743cf59021b None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:44.610557 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07197429-85f9-4ce0-b259-c743cf59021b None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:44.650042 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56825f21-de68-49cc-b2ac-a8fc59b69fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:44.650715 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56825f21-de68-49cc-b2ac-a8fc59b69fc9 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:44.651005 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56825f21-de68-49cc-b2ac-a8fc59b69fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:44.651287 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56825f21-de68-49cc-b2ac-a8fc59b69fc9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:44.691841 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:44.728604 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56825f21-de68-49cc-b2ac-a8fc59b69fc9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:44.730094 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56825f21-de68-49cc-b2ac-a8fc59b69fc9 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:44.849407 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 155/316] 10.222.0.62 () {58 vars in 1282 bytes} [Fri May 27 08:26:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 08:26:44.856015 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53573738-916c-4d96-97bd-8048030ecd8e None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:44.935433 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:44.985008 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53573738-916c-4d96-97bd-8048030ecd8e None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:45.053492 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea945fc6-a839-4adf-81a0-ad45657aaf63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:45.054964 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea945fc6-a839-4adf-81a0-ad45657aaf63 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:45.055477 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea945fc6-a839-4adf-81a0-ad45657aaf63 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:45.055981 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea945fc6-a839-4adf-81a0-ad45657aaf63 None admin] PATH_INFO: `/v3/projects/7086655a913e49b899fae73f13ec6c42` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:45.058263 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea945fc6-a839-4adf-81a0-ad45657aaf63 None admin] RBAC: Authorizing `identity:get_project(project_id=7086655a913e49b899fae73f13ec6c42)` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:45.061072 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea945fc6-a839-4adf-81a0-ad45657aaf63 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:45.071757 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 162/317] 10.222.0.62 () {56 vars in 1186 bytes} [Fri May 27 08:26:44 2022] GET /identity/v3/projects/7086655a913e49b899fae73f13ec6c42 => generated 302 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:26:45.073369 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56825f21-de68-49cc-b2ac-a8fc59b69fc9 None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:45.157068 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:45.216342 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56825f21-de68-49cc-b2ac-a8fc59b69fc9 None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:45.242599 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7b3f35-8d04-4897-ba59-360a8155f8fa None None] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:45.242895 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7b3f35-8d04-4897-ba59-360a8155f8fa None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:45.243167 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7b3f35-8d04-4897-ba59-360a8155f8fa None None] PATH_INFO: `/` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:45.244755 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 163/318] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:26:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 08:26:45.251890 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262b0b5f-9174-4800-9b0e-ce0b5b84520c None None] REQUEST_METHOD: `POST` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:45.252181 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262b0b5f-9174-4800-9b0e-ce0b5b84520c None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:45.252720 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262b0b5f-9174-4800-9b0e-ce0b5b84520c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:45.276206 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.auth.core [None req-262b0b5f-9174-4800-9b0e-ce0b5b84520c None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:26:45.277550 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.fernet_utils [None req-262b0b5f-9174-4800-9b0e-ce0b5b84520c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:26:45.278772 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743f0dd4-4c67-4ad2-aa06-537919382262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:45.279760 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743f0dd4-4c67-4ad2-aa06-537919382262 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:45.280246 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743f0dd4-4c67-4ad2-aa06-537919382262 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:45.280856 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743f0dd4-4c67-4ad2-aa06-537919382262 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:45.282024 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743f0dd4-4c67-4ad2-aa06-537919382262 None admin] RBAC: Adding query filter params (role.id=279cf625eaed4bac893add184f558fd1, scope.project.id=7086655a913e49b899fae73f13ec6c42, user.id=4f1cc13b7189408f8d266885ec60d9eb) {{(pid=87172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:26:45.282532 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743f0dd4-4c67-4ad2-aa06-537919382262 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:45.284184 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743f0dd4-4c67-4ad2-aa06-537919382262 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:45.296760 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 156/319] 10.222.0.62 () {56 vars in 1374 bytes} [Fri May 27 08:26:45 2022] GET /identity/v3/role_assignments?user.id=4f1cc13b7189408f8d266885ec60d9eb&scope.project.id=7086655a913e49b899fae73f13ec6c42&role.id=279cf625eaed4bac893add184f558fd1 => generated 608 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:26:45.360573 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 164/320] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:26:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 08:26:45.402305 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743f0dd4-4c67-4ad2-aa06-537919382262 None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:45.533707 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743f0dd4-4c67-4ad2-aa06-537919382262 None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:45.568458 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:45.574411 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5231b5a6-4da9-41f5-a280-9d0be6c1d4c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:45.575548 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5231b5a6-4da9-41f5-a280-9d0be6c1d4c7 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:45.576132 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5231b5a6-4da9-41f5-a280-9d0be6c1d4c7 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:45.576781 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5231b5a6-4da9-41f5-a280-9d0be6c1d4c7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:45.589661 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5231b5a6-4da9-41f5-a280-9d0be6c1d4c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 08:26:45.597982 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application [None req-5231b5a6-4da9-41f5-a280-9d0be6c1d4c7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 08:26:45.597982 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:26:45.597982 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:26:45.597982 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:26:45.597982 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:26:45.597982 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:26:45.597982 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:26:45.597982 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:26:45.597982 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:26:45.597982 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:26:45.597982 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:26:45.597982 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:26:45.597982 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 08:26:45.597982 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 08:26:45.597982 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 08:26:45.597982 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 08:26:45.598923 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 08:26:45.598923 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 08:26:45.598923 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 08:26:45.598923 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 08:26:45.598923 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:26:45.598923 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:26:45.598923 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:26:45.598923 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:26:45.598923 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:26:45.598923 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:26:45.598923 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:26:45.598923 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application with Lock( May 27 08:26:45.598923 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:26:45.598923 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._enter() May 27 08:26:45.598923 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:26:45.598923 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:26:45.599930 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:26:45.599930 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.creator() May 27 08:26:45.599930 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:26:45.599930 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application created_value = creator( May 27 08:26:45.599930 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 08:26:45.599930 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 08:26:45.599930 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 08:26:45.599930 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 08:26:45.599930 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 08:26:45.599930 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 08:26:45.599930 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 08:26:45.599930 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application May 27 08:26:45.599930 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 157/321] 10.222.0.62 () {56 vars in 1099 bytes} [Fri May 27 08:26:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 08:26:45.605083 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262b0b5f-9174-4800-9b0e-ce0b5b84520c None None] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:45.663912 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a925f759-fb78-4e4b-947c-01769a4c45ba None None] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:45.664236 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a925f759-fb78-4e4b-947c-01769a4c45ba None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:45.664521 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a925f759-fb78-4e4b-947c-01769a4c45ba None None] PATH_INFO: `/` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:45.665939 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 158/322] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:26:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 08:26:45.671378 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02413a0-bea2-40f3-92af-18317a7b335f None None] REQUEST_METHOD: `POST` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:45.671673 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02413a0-bea2-40f3-92af-18317a7b335f None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:45.671954 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02413a0-bea2-40f3-92af-18317a7b335f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:45.690595 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:45.692100 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.auth.core [None req-d02413a0-bea2-40f3-92af-18317a7b335f None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:26:45.693483 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.fernet_utils [None req-d02413a0-bea2-40f3-92af-18317a7b335f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:26:45.738041 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262b0b5f-9174-4800-9b0e-ce0b5b84520c None None] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:45.768660 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 159/323] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:26:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 08:26:45.768660 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04f02d5-d734-4ae6-be9e-57686ff70fda None None] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:45.768660 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04f02d5-d734-4ae6-be9e-57686ff70fda None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:45.768660 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04f02d5-d734-4ae6-be9e-57686ff70fda None None] PATH_INFO: `/` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:45.768660 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 160/324] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:26:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:26:45.774290 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97a2261-7672-4387-989a-95ced8cc5e13 None None] REQUEST_METHOD: `POST` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:45.774662 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97a2261-7672-4387-989a-95ced8cc5e13 None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:45.774951 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97a2261-7672-4387-989a-95ced8cc5e13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:45.775553 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16507059-b0d0-47f4-a44c-af64068cd429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:45.776450 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16507059-b0d0-47f4-a44c-af64068cd429 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:45.776847 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16507059-b0d0-47f4-a44c-af64068cd429 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:45.777171 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16507059-b0d0-47f4-a44c-af64068cd429 None admin] PATH_INFO: `/v3/roles` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:45.777972 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16507059-b0d0-47f4-a44c-af64068cd429 None admin] RBAC: Adding query filter params (name=member) {{(pid=87173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:26:45.778342 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16507059-b0d0-47f4-a44c-af64068cd429 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:45.779881 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16507059-b0d0-47f4-a44c-af64068cd429 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:45.792719 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 165/325] 10.222.0.62 () {56 vars in 1101 bytes} [Fri May 27 08:26:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:26:45.792719 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16507059-b0d0-47f4-a44c-af64068cd429 None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:45.797097 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.auth.core [None req-f97a2261-7672-4387-989a-95ced8cc5e13 None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:26:45.798318 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.fernet_utils [None req-f97a2261-7672-4387-989a-95ced8cc5e13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:26:45.869723 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 161/326] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:26:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 08:26:45.870589 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97a2261-7672-4387-989a-95ced8cc5e13 None None] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:45.903357 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16507059-b0d0-47f4-a44c-af64068cd429 None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:45.923351 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:45.927015 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:45.938237 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e161d40-a272-4292-a612-3cb4a9b7ed72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:45.939037 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e161d40-a272-4292-a612-3cb4a9b7ed72 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:45.939323 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e161d40-a272-4292-a612-3cb4a9b7ed72 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:45.939599 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e161d40-a272-4292-a612-3cb4a9b7ed72 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:45.941289 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e161d40-a272-4292-a612-3cb4a9b7ed72 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:45.942760 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e161d40-a272-4292-a612-3cb4a9b7ed72 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:45.944400 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 166/327] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 08:26:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 08:26:45.945720 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e161d40-a272-4292-a612-3cb4a9b7ed72 None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:45.981577 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97a2261-7672-4387-989a-95ced8cc5e13 None None] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:46.017006 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a68878-1d3a-4f32-b2a0-61b03108dd12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:46.017886 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a68878-1d3a-4f32-b2a0-61b03108dd12 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:46.018172 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a68878-1d3a-4f32-b2a0-61b03108dd12 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:46.018451 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a68878-1d3a-4f32-b2a0-61b03108dd12 None admin] PATH_INFO: `/v3/users/8641c266d9024a668e8a89a15d1cce7a` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:46.021824 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a68878-1d3a-4f32-b2a0-61b03108dd12 None admin] RBAC: Authorizing `identity:get_user(user_id=8641c266d9024a668e8a89a15d1cce7a)` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:46.023755 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a68878-1d3a-4f32-b2a0-61b03108dd12 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:46.025740 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 162/328] 10.222.0.62 () {56 vars in 1177 bytes} [Fri May 27 08:26:45 2022] GET /identity/v3/users/8641c266d9024a668e8a89a15d1cce7a => generated 293 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:26:46.027847 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a68878-1d3a-4f32-b2a0-61b03108dd12 None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:46.065466 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e161d40-a272-4292-a612-3cb4a9b7ed72 None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:46.101386 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0549f558-f8ad-4387-b689-d439fb9ae6f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:46.102190 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0549f558-f8ad-4387-b689-d439fb9ae6f4 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:46.102471 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0549f558-f8ad-4387-b689-d439fb9ae6f4 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:46.102745 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0549f558-f8ad-4387-b689-d439fb9ae6f4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:46.114376 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0549f558-f8ad-4387-b689-d439fb9ae6f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 08:26:46.122285 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application [None req-0549f558-f8ad-4387-b689-d439fb9ae6f4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 27 08:26:46.122285 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:26:46.122285 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:26:46.122285 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:26:46.122285 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:26:46.122285 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:26:46.122285 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:26:46.122285 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:26:46.122285 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:26:46.122285 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:26:46.122285 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:26:46.122285 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:26:46.122285 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 08:26:46.122285 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 08:26:46.122285 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 08:26:46.122285 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 08:26:46.123229 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 08:26:46.123229 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 08:26:46.123229 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 08:26:46.123229 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 08:26:46.123229 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:26:46.123229 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:26:46.123229 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:26:46.123229 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:26:46.123229 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:26:46.123229 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:26:46.123229 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:26:46.123229 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application with Lock( May 27 08:26:46.123229 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:26:46.123229 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._enter() May 27 08:26:46.123229 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:26:46.123229 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:26:46.124315 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:26:46.124315 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.creator() May 27 08:26:46.124315 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:26:46.124315 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application created_value = creator( May 27 08:26:46.124315 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 08:26:46.124315 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 08:26:46.124315 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 08:26:46.124315 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 08:26:46.124315 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 08:26:46.124315 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 08:26:46.124315 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 27 08:26:46.124315 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application May 27 08:26:46.124315 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 167/329] 10.222.0.62 () {56 vars in 1099 bytes} [Fri May 27 08:26:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 08:26:46.124315 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0549f558-f8ad-4387-b689-d439fb9ae6f4 None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:46.138979 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a68878-1d3a-4f32-b2a0-61b03108dd12 None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:46.164656 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:46.186686 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93fd46e-c769-490d-8f09-2224f7f0bd5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:46.188150 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93fd46e-c769-490d-8f09-2224f7f0bd5c None admin] REQUEST_METHOD: `POST` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:46.188523 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93fd46e-c769-490d-8f09-2224f7f0bd5c None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:46.189468 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:46.195636 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93fd46e-c769-490d-8f09-2224f7f0bd5c None admin] PATH_INFO: `/v3/groups` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:46.196625 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93fd46e-c769-490d-8f09-2224f7f0bd5c None admin] RBAC: Authorizing `identity:create_group()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:46.198125 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93fd46e-c769-490d-8f09-2224f7f0bd5c None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:46.215449 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 163/330] 10.222.0.62 () {60 vars in 1134 bytes} [Fri May 27 08:26:46 2022] POST /identity/v3/groups => generated 226 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 08:26:46.216308 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93fd46e-c769-490d-8f09-2224f7f0bd5c None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:46.268164 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0549f558-f8ad-4387-b689-d439fb9ae6f4 None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:46.319161 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73f18f7-6d99-4e8b-914e-8ec0679b27df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:46.320247 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73f18f7-6d99-4e8b-914e-8ec0679b27df None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:46.320632 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73f18f7-6d99-4e8b-914e-8ec0679b27df None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:46.321153 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73f18f7-6d99-4e8b-914e-8ec0679b27df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:46.322900 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73f18f7-6d99-4e8b-914e-8ec0679b27df None admin] RBAC: Adding query filter params (role.id=c980c64bb84b418daa012ae45a054b37, user.id=8641c266d9024a668e8a89a15d1cce7a, scope.system=all) {{(pid=87173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:26:46.323477 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73f18f7-6d99-4e8b-914e-8ec0679b27df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:46.326486 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73f18f7-6d99-4e8b-914e-8ec0679b27df None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:46.349936 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 168/331] 10.222.0.62 () {56 vars in 1308 bytes} [Fri May 27 08:26:46 2022] GET /identity/v3/role_assignments?user.id=8641c266d9024a668e8a89a15d1cce7a&scope.system=all&role.id=c980c64bb84b418daa012ae45a054b37 => generated 510 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:26:46.391216 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93fd46e-c769-490d-8f09-2224f7f0bd5c None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:46.439219 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1a9192-8066-4977-ba12-74becd9ad3db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:46.440236 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1a9192-8066-4977-ba12-74becd9ad3db None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:46.440742 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1a9192-8066-4977-ba12-74becd9ad3db None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:46.441165 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1a9192-8066-4977-ba12-74becd9ad3db None admin] PATH_INFO: `/v3/roles` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:46.442121 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1a9192-8066-4977-ba12-74becd9ad3db None admin] RBAC: Adding query filter params (name=reader) {{(pid=87172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:26:46.442606 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1a9192-8066-4977-ba12-74becd9ad3db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:46.444211 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1a9192-8066-4977-ba12-74becd9ad3db None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:46.457439 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 164/332] 10.222.0.62 () {56 vars in 1101 bytes} [Fri May 27 08:26:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:26:46.469158 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73f18f7-6d99-4e8b-914e-8ec0679b27df None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:46.636325 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73f18f7-6d99-4e8b-914e-8ec0679b27df None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:46.648461 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:46.687428 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa105b0-4f3a-4bec-8797-127f6de407b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:46.688376 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa105b0-4f3a-4bec-8797-127f6de407b4 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:46.688642 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa105b0-4f3a-4bec-8797-127f6de407b4 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:46.688929 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa105b0-4f3a-4bec-8797-127f6de407b4 None admin] PATH_INFO: `/v3/users/5084ddf504d649d8bfad56a4aacd9674` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:46.690231 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa105b0-4f3a-4bec-8797-127f6de407b4 None admin] RBAC: Authorizing `identity:get_user(user_id=5084ddf504d649d8bfad56a4aacd9674)` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:46.693084 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa105b0-4f3a-4bec-8797-127f6de407b4 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:46.694838 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 169/333] 10.222.0.62 () {56 vars in 1177 bytes} [Fri May 27 08:26:46 2022] GET /identity/v3/users/5084ddf504d649d8bfad56a4aacd9674 => generated 293 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:26:46.700717 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1a9192-8066-4977-ba12-74becd9ad3db None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:46.772346 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:46.855050 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1a9192-8066-4977-ba12-74becd9ad3db None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:46.902345 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660be5f3-cdec-4c68-80c4-f9fec42cc21b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:46.903148 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660be5f3-cdec-4c68-80c4-f9fec42cc21b None admin] REQUEST_METHOD: `PUT` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:46.903432 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660be5f3-cdec-4c68-80c4-f9fec42cc21b None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:46.903715 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660be5f3-cdec-4c68-80c4-f9fec42cc21b None admin] PATH_INFO: `/v3/system/users/5084ddf504d649d8bfad56a4aacd9674/roles/279cf625eaed4bac893add184f558fd1` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:46.905324 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660be5f3-cdec-4c68-80c4-f9fec42cc21b None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=5084ddf504d649d8bfad56a4aacd9674, role_id=279cf625eaed4bac893add184f558fd1)` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:46.906744 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660be5f3-cdec-4c68-80c4-f9fec42cc21b None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:46.918558 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 165/334] 10.222.0.62 () {58 vars in 1334 bytes} [Fri May 27 08:26:46 2022] PUT /identity/v3/system/users/5084ddf504d649d8bfad56a4aacd9674/roles/279cf625eaed4bac893add184f558fd1 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 08:26:49.354076 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b80389-b60f-4e8b-9ef6-e0316a3285bf None None] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:49.355180 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b80389-b60f-4e8b-9ef6-e0316a3285bf None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:49.355689 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b80389-b60f-4e8b-9ef6-e0316a3285bf None None] PATH_INFO: `/` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:49.357887 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 170/335] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:26:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:26:49.364245 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9f0ffe-64fd-4158-b8e9-5b5f30051ccf None None] REQUEST_METHOD: `POST` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:49.364805 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9f0ffe-64fd-4158-b8e9-5b5f30051ccf None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:49.364895 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9f0ffe-64fd-4158-b8e9-5b5f30051ccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:49.394772 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.auth.core [None req-7f9f0ffe-64fd-4158-b8e9-5b5f30051ccf None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:26:49.395997 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.fernet_utils [None req-7f9f0ffe-64fd-4158-b8e9-5b5f30051ccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:26:49.483329 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 166/336] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:26:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 08:26:49.522532 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b80389-b60f-4e8b-9ef6-e0316a3285bf None None] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:49.685804 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b80389-b60f-4e8b-9ef6-e0316a3285bf None None] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:49.729617 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b924eee-239e-4e9f-bc9c-ff8fd3b42528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:49.730786 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b924eee-239e-4e9f-bc9c-ff8fd3b42528 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:49.731273 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b924eee-239e-4e9f-bc9c-ff8fd3b42528 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:49.731766 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b924eee-239e-4e9f-bc9c-ff8fd3b42528 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:49.747525 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b924eee-239e-4e9f-bc9c-ff8fd3b42528 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 08:26:49.756266 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application [None req-3b924eee-239e-4e9f-bc9c-ff8fd3b42528 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 08:26:49.756266 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:26:49.756266 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:26:49.756266 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:26:49.756266 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:26:49.756266 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:26:49.756266 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:26:49.756266 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:26:49.756266 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:26:49.756266 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:26:49.756266 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:26:49.756266 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:26:49.756266 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 08:26:49.756266 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 08:26:49.756266 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 08:26:49.756266 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 08:26:49.757265 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 08:26:49.757265 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 08:26:49.757265 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 08:26:49.757265 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 08:26:49.757265 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:26:49.757265 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:26:49.757265 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:26:49.757265 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:26:49.757265 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:26:49.757265 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:26:49.757265 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:26:49.757265 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application with Lock( May 27 08:26:49.757265 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:26:49.757265 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._enter() May 27 08:26:49.757265 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:26:49.757265 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:26:49.758061 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:26:49.758061 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.creator() May 27 08:26:49.758061 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:26:49.758061 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application created_value = creator( May 27 08:26:49.758061 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 08:26:49.758061 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 08:26:49.758061 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 08:26:49.758061 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 08:26:49.758061 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 08:26:49.758061 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 08:26:49.758061 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 08:26:49.758061 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application May 27 08:26:49.760877 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 171/337] 10.222.0.62 () {56 vars in 1099 bytes} [Fri May 27 08:26:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 08:26:49.769871 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9f0ffe-64fd-4158-b8e9-5b5f30051ccf None None] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:49.826751 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:49.915916 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9f0ffe-64fd-4158-b8e9-5b5f30051ccf None None] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:49.960331 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78ac0b6-0e8a-4ed0-9ce7-5fbde68b6931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:49.961081 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78ac0b6-0e8a-4ed0-9ce7-5fbde68b6931 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:49.961366 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78ac0b6-0e8a-4ed0-9ce7-5fbde68b6931 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:49.961641 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78ac0b6-0e8a-4ed0-9ce7-5fbde68b6931 None admin] PATH_INFO: `/v3/roles` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:49.962409 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78ac0b6-0e8a-4ed0-9ce7-5fbde68b6931 None admin] RBAC: Adding query filter params (name=member) {{(pid=87172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:26:49.962715 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78ac0b6-0e8a-4ed0-9ce7-5fbde68b6931 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:49.964124 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78ac0b6-0e8a-4ed0-9ce7-5fbde68b6931 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:49.974564 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 167/338] 10.222.0.62 () {56 vars in 1101 bytes} [Fri May 27 08:26:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:26:49.980304 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b924eee-239e-4e9f-bc9c-ff8fd3b42528 None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:50.027496 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f092898b-74cf-4823-ada6-e6ef4f0dcbeb None None] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:50.028154 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f092898b-74cf-4823-ada6-e6ef4f0dcbeb None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:50.028689 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f092898b-74cf-4823-ada6-e6ef4f0dcbeb None None] PATH_INFO: `/` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:50.030660 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 168/339] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:26:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:26:50.037257 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bea8929-6cf2-468d-a51e-610db94996e9 None None] REQUEST_METHOD: `POST` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:50.037966 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bea8929-6cf2-468d-a51e-610db94996e9 None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:50.038453 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bea8929-6cf2-468d-a51e-610db94996e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:50.063552 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:50.076714 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.auth.core [None req-3bea8929-6cf2-468d-a51e-610db94996e9 None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:26:50.078307 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.fernet_utils [None req-3bea8929-6cf2-468d-a51e-610db94996e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:26:50.238103 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b924eee-239e-4e9f-bc9c-ff8fd3b42528 None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:50.276642 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 169/340] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:26:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 08:26:50.304492 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8d8891-d46e-447c-946b-8d7f4e6d324c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:50.305213 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8d8891-d46e-447c-946b-8d7f4e6d324c None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:50.305505 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8d8891-d46e-447c-946b-8d7f4e6d324c None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:50.305791 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8d8891-d46e-447c-946b-8d7f4e6d324c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:50.317107 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bea8929-6cf2-468d-a51e-610db94996e9 None None] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:50.401219 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8d8891-d46e-447c-946b-8d7f4e6d324c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:50.403272 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8d8891-d46e-447c-946b-8d7f4e6d324c None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:50.409736 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:50.457099 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:50.547866 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 172/341] 10.222.0.62 () {58 vars in 1282 bytes} [Fri May 27 08:26:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 568 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 08:26:50.549485 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bf2937-2704-4c22-bfd6-4243398a72d9 None None] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:50.550478 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bf2937-2704-4c22-bfd6-4243398a72d9 None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:50.550918 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bf2937-2704-4c22-bfd6-4243398a72d9 None None] PATH_INFO: `/` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:50.552753 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 173/342] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:26:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:26:50.555445 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bf2937-2704-4c22-bfd6-4243398a72d9 None None] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:50.582074 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bea8929-6cf2-468d-a51e-610db94996e9 None None] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:50.654639 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67b3d14-b8de-448d-93d4-4d722ace2f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:50.655707 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67b3d14-b8de-448d-93d4-4d722ace2f17 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:50.656155 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67b3d14-b8de-448d-93d4-4d722ace2f17 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:50.656624 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67b3d14-b8de-448d-93d4-4d722ace2f17 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:50.670604 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67b3d14-b8de-448d-93d4-4d722ace2f17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 08:26:50.679533 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application [None req-e67b3d14-b8de-448d-93d4-4d722ace2f17 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 08:26:50.679533 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:26:50.679533 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:26:50.679533 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:26:50.679533 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:26:50.679533 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:26:50.679533 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:26:50.679533 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:26:50.679533 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:26:50.679533 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:26:50.679533 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:26:50.679533 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:26:50.679533 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 08:26:50.679533 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 08:26:50.679533 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 08:26:50.679533 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 08:26:50.680675 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 08:26:50.680675 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 08:26:50.680675 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 08:26:50.680675 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 08:26:50.680675 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:26:50.680675 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:26:50.680675 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:26:50.680675 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:26:50.680675 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:26:50.680675 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:26:50.680675 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:26:50.680675 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application with Lock( May 27 08:26:50.680675 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:26:50.680675 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._enter() May 27 08:26:50.680675 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:26:50.680675 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:26:50.681687 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:26:50.681687 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.creator() May 27 08:26:50.681687 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:26:50.681687 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application created_value = creator( May 27 08:26:50.681687 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 08:26:50.681687 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 08:26:50.681687 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 08:26:50.681687 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 08:26:50.681687 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 08:26:50.681687 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 08:26:50.681687 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 08:26:50.681687 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application May 27 08:26:50.684142 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 170/343] 10.222.0.62 () {56 vars in 1114 bytes} [Fri May 27 08:26:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 369 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 08:26:50.685569 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4ad1a5-90a7-403e-8d20-8ab7f631d1c6 None None] REQUEST_METHOD: `POST` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:50.686011 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4ad1a5-90a7-403e-8d20-8ab7f631d1c6 None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:50.686434 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4ad1a5-90a7-403e-8d20-8ab7f631d1c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:50.709117 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.auth.core [None req-ad4ad1a5-90a7-403e-8d20-8ab7f631d1c6 None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:26:50.710602 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.fernet_utils [None req-ad4ad1a5-90a7-403e-8d20-8ab7f631d1c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:26:50.791214 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 171/344] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:26:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 08:26:50.792312 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4ad1a5-90a7-403e-8d20-8ab7f631d1c6 None None] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:50.819659 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:50.875840 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bf2937-2704-4c22-bfd6-4243398a72d9 None None] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:50.921241 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4ad1a5-90a7-403e-8d20-8ab7f631d1c6 None None] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:50.963697 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6adebd-8ac4-47d1-9284-f9f5acbea3ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:50.964689 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6adebd-8ac4-47d1-9284-f9f5acbea3ec None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:50.965124 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6adebd-8ac4-47d1-9284-f9f5acbea3ec None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:50.965549 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6adebd-8ac4-47d1-9284-f9f5acbea3ec None admin] PATH_INFO: `/v3/roles` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:50.966500 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6adebd-8ac4-47d1-9284-f9f5acbea3ec None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:26:50.966961 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6adebd-8ac4-47d1-9284-f9f5acbea3ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:50.968548 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6adebd-8ac4-47d1-9284-f9f5acbea3ec None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:50.978898 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 172/345] 10.222.0.62 () {56 vars in 1111 bytes} [Fri May 27 08:26:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:26:50.980101 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6adebd-8ac4-47d1-9284-f9f5acbea3ec None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:50.998797 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5bd57d-95bb-4c92-8438-adc541e17823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:50.999853 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5bd57d-95bb-4c92-8438-adc541e17823 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:51.000129 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5bd57d-95bb-4c92-8438-adc541e17823 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:51.000574 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5bd57d-95bb-4c92-8438-adc541e17823 None admin] PATH_INFO: `/v3/projects/befb09928b604b3e89c10a3f78d3aede` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:51.005626 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5bd57d-95bb-4c92-8438-adc541e17823 None admin] RBAC: Authorizing `identity:get_project(project_id=befb09928b604b3e89c10a3f78d3aede)` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:51.007446 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5bd57d-95bb-4c92-8438-adc541e17823 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:51.009864 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 174/346] 10.222.0.62 () {56 vars in 1186 bytes} [Fri May 27 08:26:50 2022] GET /identity/v3/projects/befb09928b604b3e89c10a3f78d3aede => generated 298 bytes in 455 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:26:51.010953 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5bd57d-95bb-4c92-8438-adc541e17823 None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:51.020947 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:51.085702 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:51.111446 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6adebd-8ac4-47d1-9284-f9f5acbea3ec None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:51.159942 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65396e5c-445c-47db-bf35-7503f364baaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:51.161182 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65396e5c-445c-47db-bf35-7503f364baaf None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:51.162656 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65396e5c-445c-47db-bf35-7503f364baaf None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:51.163382 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65396e5c-445c-47db-bf35-7503f364baaf None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:51.182797 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65396e5c-445c-47db-bf35-7503f364baaf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 08:26:51.193427 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application [None req-65396e5c-445c-47db-bf35-7503f364baaf None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 27 08:26:51.193427 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:26:51.193427 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:26:51.193427 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:26:51.193427 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:26:51.193427 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:26:51.193427 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:26:51.193427 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:26:51.193427 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:26:51.193427 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:26:51.193427 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:26:51.193427 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:26:51.193427 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 08:26:51.193427 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 08:26:51.193427 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 08:26:51.193427 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 08:26:51.194702 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 08:26:51.194702 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 08:26:51.194702 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 08:26:51.194702 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 08:26:51.194702 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:26:51.194702 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:26:51.194702 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:26:51.194702 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:26:51.194702 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:26:51.194702 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:26:51.194702 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:26:51.194702 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application with Lock( May 27 08:26:51.194702 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:26:51.194702 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._enter() May 27 08:26:51.194702 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:26:51.194702 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:26:51.195724 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:26:51.195724 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.creator() May 27 08:26:51.195724 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:26:51.195724 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application created_value = creator( May 27 08:26:51.195724 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 08:26:51.195724 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 08:26:51.195724 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 08:26:51.195724 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 08:26:51.195724 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 08:26:51.195724 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 08:26:51.195724 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 27 08:26:51.195724 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application May 27 08:26:51.198521 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 173/347] 10.222.0.62 () {56 vars in 1099 bytes} [Fri May 27 08:26:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 08:26:51.199598 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65396e5c-445c-47db-bf35-7503f364baaf None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:51.325243 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5bd57d-95bb-4c92-8438-adc541e17823 None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:51.328279 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65396e5c-445c-47db-bf35-7503f364baaf None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:51.371792 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59af5eb-ba04-4a49-885f-129e58cc670f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:51.372995 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59af5eb-ba04-4a49-885f-129e58cc670f None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:51.373457 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59af5eb-ba04-4a49-885f-129e58cc670f None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:51.373941 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59af5eb-ba04-4a49-885f-129e58cc670f None admin] PATH_INFO: `/v3/groups/1edbdb0d4e6e40bba8a9c900d741bc93` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:51.382745 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59af5eb-ba04-4a49-885f-129e58cc670f None admin] RBAC: Authorizing `identity:get_group(group_id=1edbdb0d4e6e40bba8a9c900d741bc93)` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:51.384529 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59af5eb-ba04-4a49-885f-129e58cc670f None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:51.385742 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f58def0-5a22-4ce3-9f9c-c32c9048212e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:51.386561 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f58def0-5a22-4ce3-9f9c-c32c9048212e None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:51.387056 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 174/348] 10.222.0.62 () {56 vars in 1180 bytes} [Fri May 27 08:26:51 2022] GET /identity/v3/groups/1edbdb0d4e6e40bba8a9c900d741bc93 => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:26:51.387415 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f58def0-5a22-4ce3-9f9c-c32c9048212e None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:51.387710 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f58def0-5a22-4ce3-9f9c-c32c9048212e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:51.388621 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59af5eb-ba04-4a49-885f-129e58cc670f None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:51.393653 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:51.478554 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f58def0-5a22-4ce3-9f9c-c32c9048212e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:51.480061 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f58def0-5a22-4ce3-9f9c-c32c9048212e None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:51.483651 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:51.521530 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59af5eb-ba04-4a49-885f-129e58cc670f None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:51.562628 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968b48de-2dfc-4e56-a17c-76a79a51dd1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:51.563784 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968b48de-2dfc-4e56-a17c-76a79a51dd1d None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:51.564278 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968b48de-2dfc-4e56-a17c-76a79a51dd1d None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:51.564899 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968b48de-2dfc-4e56-a17c-76a79a51dd1d None admin] PATH_INFO: `/v3/roles` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:51.565969 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968b48de-2dfc-4e56-a17c-76a79a51dd1d None admin] RBAC: Adding query filter params (name=reader) {{(pid=87172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:26:51.566583 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968b48de-2dfc-4e56-a17c-76a79a51dd1d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:51.568223 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968b48de-2dfc-4e56-a17c-76a79a51dd1d None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:51.578531 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 175/349] 10.222.0.62 () {56 vars in 1101 bytes} [Fri May 27 08:26:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:26:51.580234 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e902ef7-bfd9-4743-b0ca-40d7d67fe246 None None] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:51.580720 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e902ef7-bfd9-4743-b0ca-40d7d67fe246 None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:51.582280 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e902ef7-bfd9-4743-b0ca-40d7d67fe246 None None] PATH_INFO: `/` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:51.584202 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 176/350] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:26:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:26:51.585187 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e902ef7-bfd9-4743-b0ca-40d7d67fe246 None None] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:51.604371 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 175/351] 10.222.0.62 () {58 vars in 1282 bytes} [Fri May 27 08:26:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 594 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 08:26:51.605972 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c43402-af47-4ac8-b8f5-1632c0e69cb3 None None] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:51.606267 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c43402-af47-4ac8-b8f5-1632c0e69cb3 None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:51.606546 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c43402-af47-4ac8-b8f5-1632c0e69cb3 None None] PATH_INFO: `/` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:51.608019 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 176/352] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:26:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:26:51.608684 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c43402-af47-4ac8-b8f5-1632c0e69cb3 None None] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:51.676209 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:51.739511 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e902ef7-bfd9-4743-b0ca-40d7d67fe246 None None] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:51.750675 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c43402-af47-4ac8-b8f5-1632c0e69cb3 None None] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:51.753087 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:51.802696 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffc218b-f744-451e-8a49-a71ab63f25fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:51.803377 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffc218b-f744-451e-8a49-a71ab63f25fb None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:51.803660 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffc218b-f744-451e-8a49-a71ab63f25fb None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:51.803940 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffc218b-f744-451e-8a49-a71ab63f25fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:51.804875 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffc218b-f744-451e-8a49-a71ab63f25fb None admin] RBAC: Adding query filter params (group.id=1edbdb0d4e6e40bba8a9c900d741bc93, role.id=c980c64bb84b418daa012ae45a054b37, scope.project.id=befb09928b604b3e89c10a3f78d3aede) {{(pid=87172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:26:51.805190 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffc218b-f744-451e-8a49-a71ab63f25fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:51.806658 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffc218b-f744-451e-8a49-a71ab63f25fb None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:51.808021 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21059323-ad08-4063-886a-bed80b305bf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:51.809668 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21059323-ad08-4063-886a-bed80b305bf8 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:51.811632 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21059323-ad08-4063-886a-bed80b305bf8 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:51.811632 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21059323-ad08-4063-886a-bed80b305bf8 None admin] PATH_INFO: `/v3/users/5084ddf504d649d8bfad56a4aacd9674` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:51.816737 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 177/353] 10.222.0.62 () {56 vars in 1376 bytes} [Fri May 27 08:26:51 2022] GET /identity/v3/role_assignments?group.id=1edbdb0d4e6e40bba8a9c900d741bc93&scope.project.id=befb09928b604b3e89c10a3f78d3aede&role.id=c980c64bb84b418daa012ae45a054b37 => generated 260 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:26:51.816928 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21059323-ad08-4063-886a-bed80b305bf8 None admin] RBAC: Authorizing `identity:get_user(user_id=5084ddf504d649d8bfad56a4aacd9674)` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:51.817015 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9497f4-957c-4ec2-b4d9-6fb48fd7043b None None] REQUEST_METHOD: `POST` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:51.817015 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9497f4-957c-4ec2-b4d9-6fb48fd7043b None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:51.817015 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9497f4-957c-4ec2-b4d9-6fb48fd7043b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:51.818175 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21059323-ad08-4063-886a-bed80b305bf8 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:51.824908 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 177/354] 10.222.0.62 () {56 vars in 1177 bytes} [Fri May 27 08:26:51 2022] GET /identity/v3/users/5084ddf504d649d8bfad56a4aacd9674 => generated 293 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:26:51.824908 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21059323-ad08-4063-886a-bed80b305bf8 None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:51.855582 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.auth.core [None req-bd9497f4-957c-4ec2-b4d9-6fb48fd7043b None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:26:51.857894 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.fernet_utils [None req-bd9497f4-957c-4ec2-b4d9-6fb48fd7043b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:26:51.963979 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 178/355] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:26:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 08:26:51.965286 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cd9b53-636b-4db7-b3ed-52c788dc4963 None None] REQUEST_METHOD: `POST` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:51.965585 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cd9b53-636b-4db7-b3ed-52c788dc4963 None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:51.965867 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cd9b53-636b-4db7-b3ed-52c788dc4963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:51.988229 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.auth.core [None req-35cd9b53-636b-4db7-b3ed-52c788dc4963 None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:26:51.989498 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.fernet_utils [None req-35cd9b53-636b-4db7-b3ed-52c788dc4963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:26:52.000648 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21059323-ad08-4063-886a-bed80b305bf8 None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:52.058016 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31735672-a81f-4fb0-9334-9367e43dbd0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:52.058887 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31735672-a81f-4fb0-9334-9367e43dbd0e None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:52.059168 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31735672-a81f-4fb0-9334-9367e43dbd0e None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:52.059443 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31735672-a81f-4fb0-9334-9367e43dbd0e None admin] PATH_INFO: `/v3/projects/befb09928b604b3e89c10a3f78d3aede` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:52.061564 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31735672-a81f-4fb0-9334-9367e43dbd0e None admin] RBAC: Authorizing `identity:get_project(project_id=befb09928b604b3e89c10a3f78d3aede)` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:52.062265 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31735672-a81f-4fb0-9334-9367e43dbd0e None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:52.064029 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 178/356] 10.222.0.62 () {56 vars in 1186 bytes} [Fri May 27 08:26:51 2022] GET /identity/v3/projects/befb09928b604b3e89c10a3f78d3aede => generated 298 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:26:52.067111 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31735672-a81f-4fb0-9334-9367e43dbd0e None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:52.072373 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:52.089319 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 179/357] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:26:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 08:26:52.090423 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def41917-e1b7-4291-8224-0c71ec3e51a1 None None] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:52.090712 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def41917-e1b7-4291-8224-0c71ec3e51a1 None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:52.091576 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def41917-e1b7-4291-8224-0c71ec3e51a1 None None] PATH_INFO: `/` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:52.093462 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 180/358] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:26:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:26:52.094046 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def41917-e1b7-4291-8224-0c71ec3e51a1 None None] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:52.140265 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:52.262665 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31735672-a81f-4fb0-9334-9367e43dbd0e None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:52.271280 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def41917-e1b7-4291-8224-0c71ec3e51a1 None None] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:52.312888 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423fc379-6817-4252-9bbc-e04cbc533c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:52.313563 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423fc379-6817-4252-9bbc-e04cbc533c5c None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:52.313839 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423fc379-6817-4252-9bbc-e04cbc533c5c None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:52.314126 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423fc379-6817-4252-9bbc-e04cbc533c5c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:52.314991 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423fc379-6817-4252-9bbc-e04cbc533c5c None admin] RBAC: Adding query filter params (role.id=279cf625eaed4bac893add184f558fd1, user.id=5084ddf504d649d8bfad56a4aacd9674, scope.system=all) {{(pid=87173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:26:52.315363 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423fc379-6817-4252-9bbc-e04cbc533c5c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:52.317141 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423fc379-6817-4252-9bbc-e04cbc533c5c None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:52.327008 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4373efd-8fa2-4240-8223-7097d4cc036d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:52.329080 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4373efd-8fa2-4240-8223-7097d4cc036d None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:52.329880 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4373efd-8fa2-4240-8223-7097d4cc036d None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:52.330670 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4373efd-8fa2-4240-8223-7097d4cc036d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:52.331682 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 179/359] 10.222.0.62 () {56 vars in 1308 bytes} [Fri May 27 08:26:52 2022] GET /identity/v3/role_assignments?user.id=5084ddf504d649d8bfad56a4aacd9674&scope.system=all&role.id=279cf625eaed4bac893add184f558fd1 => generated 510 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:26:52.334487 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423fc379-6817-4252-9bbc-e04cbc533c5c None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:52.357451 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4373efd-8fa2-4240-8223-7097d4cc036d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 08:26:52.385134 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application [None req-f4373efd-8fa2-4240-8223-7097d4cc036d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 08:26:52.385134 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:26:52.385134 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:26:52.385134 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:26:52.385134 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:26:52.385134 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:26:52.385134 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:26:52.385134 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:26:52.385134 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:26:52.385134 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:26:52.385134 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:26:52.385134 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:26:52.385134 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 08:26:52.385134 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 08:26:52.385134 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 08:26:52.385134 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 08:26:52.386878 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 08:26:52.386878 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 08:26:52.386878 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 08:26:52.386878 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 08:26:52.386878 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:26:52.386878 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:26:52.386878 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:26:52.386878 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:26:52.386878 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:26:52.386878 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:26:52.386878 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:26:52.386878 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application with Lock( May 27 08:26:52.386878 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:26:52.386878 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._enter() May 27 08:26:52.386878 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:26:52.386878 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:26:52.388468 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:26:52.388468 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.creator() May 27 08:26:52.388468 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:26:52.388468 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application created_value = creator( May 27 08:26:52.388468 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 08:26:52.388468 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 08:26:52.388468 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 08:26:52.388468 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 08:26:52.388468 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 08:26:52.388468 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 08:26:52.388468 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 08:26:52.388468 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application May 27 08:26:52.388468 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 181/360] 10.222.0.62 () {56 vars in 1114 bytes} [Fri May 27 08:26:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 08:26:52.388468 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353fac63-a4c8-45d1-a0f0-4dca8baa3b8a None None] REQUEST_METHOD: `POST` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:52.391378 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353fac63-a4c8-45d1-a0f0-4dca8baa3b8a None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:52.391378 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353fac63-a4c8-45d1-a0f0-4dca8baa3b8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:52.416462 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.auth.core [None req-353fac63-a4c8-45d1-a0f0-4dca8baa3b8a None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:26:52.418346 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.fernet_utils [None req-353fac63-a4c8-45d1-a0f0-4dca8baa3b8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:26:52.483774 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:52.489836 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423fc379-6817-4252-9bbc-e04cbc533c5c None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:52.513269 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:52.556139 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3debfaf4-5fc1-4617-bc1e-1b043b7e3f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:52.556139 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3debfaf4-5fc1-4617-bc1e-1b043b7e3f41 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:52.556735 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3debfaf4-5fc1-4617-bc1e-1b043b7e3f41 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:52.557122 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3debfaf4-5fc1-4617-bc1e-1b043b7e3f41 None admin] PATH_INFO: `/v3/groups/1edbdb0d4e6e40bba8a9c900d741bc93` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:52.558982 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3debfaf4-5fc1-4617-bc1e-1b043b7e3f41 None admin] RBAC: Authorizing `identity:get_group(group_id=1edbdb0d4e6e40bba8a9c900d741bc93)` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:52.560783 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3debfaf4-5fc1-4617-bc1e-1b043b7e3f41 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:52.562837 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 180/361] 10.222.0.62 () {56 vars in 1180 bytes} [Fri May 27 08:26:52 2022] GET /identity/v3/groups/1edbdb0d4e6e40bba8a9c900d741bc93 => generated 226 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:26:52.563762 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 182/362] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:26:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 08:26:52.564214 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3debfaf4-5fc1-4617-bc1e-1b043b7e3f41 None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:52.565437 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353fac63-a4c8-45d1-a0f0-4dca8baa3b8a None None] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:52.747183 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3debfaf4-5fc1-4617-bc1e-1b043b7e3f41 None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:52.765682 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353fac63-a4c8-45d1-a0f0-4dca8baa3b8a None None] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:52.817696 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc456ae-374d-447d-a738-82a8f268ea01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:52.818515 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc456ae-374d-447d-a738-82a8f268ea01 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:52.818796 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc456ae-374d-447d-a738-82a8f268ea01 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:52.819179 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc456ae-374d-447d-a738-82a8f268ea01 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:52.821761 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd26745-5614-43d0-9b52-40d32fb7a5d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:52.822728 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd26745-5614-43d0-9b52-40d32fb7a5d8 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:52.823020 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd26745-5614-43d0-9b52-40d32fb7a5d8 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:52.823380 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd26745-5614-43d0-9b52-40d32fb7a5d8 None admin] PATH_INFO: `/v3/roles` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:52.824295 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd26745-5614-43d0-9b52-40d32fb7a5d8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:26:52.824721 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd26745-5614-43d0-9b52-40d32fb7a5d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:52.826156 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd26745-5614-43d0-9b52-40d32fb7a5d8 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:52.832045 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc456ae-374d-447d-a738-82a8f268ea01 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 08:26:52.837332 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 183/363] 10.222.0.62 () {56 vars in 1111 bytes} [Fri May 27 08:26:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:26:52.839801 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd26745-5614-43d0-9b52-40d32fb7a5d8 None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:52.843466 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application [None req-4fc456ae-374d-447d-a738-82a8f268ea01 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 08:26:52.843466 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:26:52.843466 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:26:52.843466 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:26:52.843466 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:26:52.843466 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:26:52.843466 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:26:52.843466 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:26:52.843466 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:26:52.843466 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:26:52.843466 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:26:52.843466 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:26:52.843466 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 08:26:52.843466 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 08:26:52.843466 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 08:26:52.843466 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 08:26:52.844583 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 08:26:52.844583 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 08:26:52.844583 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 08:26:52.844583 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 08:26:52.844583 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:26:52.844583 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:26:52.844583 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:26:52.844583 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:26:52.844583 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:26:52.844583 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:26:52.844583 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:26:52.844583 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application with Lock( May 27 08:26:52.844583 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:26:52.844583 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._enter() May 27 08:26:52.844583 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:26:52.844583 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:26:52.845451 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:26:52.845451 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.creator() May 27 08:26:52.845451 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:26:52.845451 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application created_value = creator( May 27 08:26:52.845451 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 08:26:52.845451 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 08:26:52.845451 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 08:26:52.845451 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 08:26:52.845451 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 08:26:52.845451 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 08:26:52.845451 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 08:26:52.845451 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application May 27 08:26:52.846065 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 181/364] 10.222.0.62 () {56 vars in 1099 bytes} [Fri May 27 08:26:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 08:26:52.847840 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc456ae-374d-447d-a738-82a8f268ea01 None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:52.878781 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:52.902386 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:52.979251 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc456ae-374d-447d-a738-82a8f268ea01 None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:53.007375 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd26745-5614-43d0-9b52-40d32fb7a5d8 None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:53.041362 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e448cbd-3017-4333-a8b6-da9722116a37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:53.042199 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e448cbd-3017-4333-a8b6-da9722116a37 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:53.042504 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e448cbd-3017-4333-a8b6-da9722116a37 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:53.042815 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e448cbd-3017-4333-a8b6-da9722116a37 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:53.059182 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e448cbd-3017-4333-a8b6-da9722116a37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 08:26:53.066778 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application [None req-8e448cbd-3017-4333-a8b6-da9722116a37 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 08:26:53.066778 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:26:53.066778 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:26:53.066778 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:26:53.066778 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:26:53.066778 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:26:53.066778 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:26:53.066778 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:26:53.066778 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:26:53.066778 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:26:53.066778 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:26:53.066778 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:26:53.066778 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 08:26:53.066778 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 08:26:53.066778 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 08:26:53.066778 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 08:26:53.067832 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 08:26:53.067832 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 08:26:53.067832 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 08:26:53.067832 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 08:26:53.067832 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:26:53.067832 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:26:53.067832 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:26:53.067832 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:26:53.067832 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:26:53.067832 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:26:53.067832 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:26:53.067832 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application with Lock( May 27 08:26:53.067832 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:26:53.067832 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._enter() May 27 08:26:53.067832 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:26:53.067832 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:26:53.068918 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:26:53.068918 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.creator() May 27 08:26:53.068918 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:26:53.068918 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application created_value = creator( May 27 08:26:53.068918 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 08:26:53.068918 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 08:26:53.068918 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 08:26:53.068918 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 08:26:53.068918 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 08:26:53.068918 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 08:26:53.068918 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 08:26:53.068918 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application May 27 08:26:53.068918 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 182/365] 10.222.0.62 () {56 vars in 1096 bytes} [Fri May 27 08:26:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 08:26:53.068918 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e448cbd-3017-4333-a8b6-da9722116a37 None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:53.074783 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da3c640-5d18-481c-a49d-eb3cbced334f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:53.075463 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da3c640-5d18-481c-a49d-eb3cbced334f None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:53.075754 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da3c640-5d18-481c-a49d-eb3cbced334f None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:53.076038 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da3c640-5d18-481c-a49d-eb3cbced334f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:53.076929 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da3c640-5d18-481c-a49d-eb3cbced334f None admin] RBAC: Adding query filter params (group.id=1edbdb0d4e6e40bba8a9c900d741bc93, role.id=9ff71fb5e7b7407d8d243eaa7da0a125, scope.project.id=befb09928b604b3e89c10a3f78d3aede) {{(pid=87172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:26:53.077247 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da3c640-5d18-481c-a49d-eb3cbced334f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:53.078713 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da3c640-5d18-481c-a49d-eb3cbced334f None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:53.089342 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 184/366] 10.222.0.62 () {56 vars in 1376 bytes} [Fri May 27 08:26:52 2022] GET /identity/v3/role_assignments?group.id=1edbdb0d4e6e40bba8a9c900d741bc93&scope.project.id=befb09928b604b3e89c10a3f78d3aede&role.id=9ff71fb5e7b7407d8d243eaa7da0a125 => generated 260 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:26:53.089342 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da3c640-5d18-481c-a49d-eb3cbced334f None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:53.196989 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:53.223910 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e448cbd-3017-4333-a8b6-da9722116a37 None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:53.284953 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da3c640-5d18-481c-a49d-eb3cbced334f None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:53.296551 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc175879-2f0a-4770-abe4-2a4895eb4878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:53.297198 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:53.298577 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc175879-2f0a-4770-abe4-2a4895eb4878 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:53.299085 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc175879-2f0a-4770-abe4-2a4895eb4878 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:53.300112 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc175879-2f0a-4770-abe4-2a4895eb4878 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:53.333888 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef67a05d-ffce-497d-8e78-bc3d0043c475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:53.334577 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef67a05d-ffce-497d-8e78-bc3d0043c475 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:53.334869 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef67a05d-ffce-497d-8e78-bc3d0043c475 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:53.335151 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef67a05d-ffce-497d-8e78-bc3d0043c475 None admin] PATH_INFO: `/v3/roles` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:53.335925 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef67a05d-ffce-497d-8e78-bc3d0043c475 None admin] RBAC: Adding query filter params (name=member) {{(pid=87172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:26:53.336237 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef67a05d-ffce-497d-8e78-bc3d0043c475 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:53.337747 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef67a05d-ffce-497d-8e78-bc3d0043c475 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:53.349391 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 185/367] 10.222.0.62 () {56 vars in 1101 bytes} [Fri May 27 08:26:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:26:53.351358 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef67a05d-ffce-497d-8e78-bc3d0043c475 None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:53.437895 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc175879-2f0a-4770-abe4-2a4895eb4878 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:53.438093 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc175879-2f0a-4770-abe4-2a4895eb4878 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:53.510941 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef67a05d-ffce-497d-8e78-bc3d0043c475 None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:53.561825 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd34bd5-03e0-42fa-ad1e-045bd945c984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:53.562742 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd34bd5-03e0-42fa-ad1e-045bd945c984 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:53.563243 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd34bd5-03e0-42fa-ad1e-045bd945c984 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:53.563901 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd34bd5-03e0-42fa-ad1e-045bd945c984 None admin] PATH_INFO: `/v3/roles` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:53.566027 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd34bd5-03e0-42fa-ad1e-045bd945c984 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:26:53.566584 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd34bd5-03e0-42fa-ad1e-045bd945c984 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:53.567085 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:53.569242 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd34bd5-03e0-42fa-ad1e-045bd945c984 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:53.580027 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 186/368] 10.222.0.62 () {56 vars in 1099 bytes} [Fri May 27 08:26:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:26:53.581626 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd34bd5-03e0-42fa-ad1e-045bd945c984 None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:53.591478 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 183/369] 10.222.0.62 () {58 vars in 1282 bytes} [Fri May 27 08:26:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 523 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 08:26:53.592429 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc175879-2f0a-4770-abe4-2a4895eb4878 None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:53.630691 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:53.745815 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd34bd5-03e0-42fa-ad1e-045bd945c984 None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:53.749834 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc175879-2f0a-4770-abe4-2a4895eb4878 None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:53.788849 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d6281b-78fa-4c7b-9fda-8a78720c318d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:53.789528 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d6281b-78fa-4c7b-9fda-8a78720c318d None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:53.789843 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d6281b-78fa-4c7b-9fda-8a78720c318d None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:53.790079 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d6281b-78fa-4c7b-9fda-8a78720c318d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:53.791395 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804dc545-23cf-449f-b4f1-d4fc9ac6a573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:53.792294 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804dc545-23cf-449f-b4f1-d4fc9ac6a573 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:53.792826 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804dc545-23cf-449f-b4f1-d4fc9ac6a573 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:53.793307 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804dc545-23cf-449f-b4f1-d4fc9ac6a573 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:53.852126 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:53.869169 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804dc545-23cf-449f-b4f1-d4fc9ac6a573 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:53.870999 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804dc545-23cf-449f-b4f1-d4fc9ac6a573 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:53.874996 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d6281b-78fa-4c7b-9fda-8a78720c318d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:53.876464 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d6281b-78fa-4c7b-9fda-8a78720c318d None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:53.912491 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:53.991249 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 184/370] 10.222.0.62 () {58 vars in 1282 bytes} [Fri May 27 08:26:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 08:26:53.991920 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804dc545-23cf-449f-b4f1-d4fc9ac6a573 None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:54.019622 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 187/371] 10.222.0.62 () {58 vars in 1282 bytes} [Fri May 27 08:26:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 08:26:54.021399 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d6281b-78fa-4c7b-9fda-8a78720c318d None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:54.120924 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:54.162366 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804dc545-23cf-449f-b4f1-d4fc9ac6a573 None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:54.171428 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d6281b-78fa-4c7b-9fda-8a78720c318d None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:54.213647 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ddd932-9788-422e-a02a-fb114ff1a4ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:54.215098 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ddd932-9788-422e-a02a-fb114ff1a4ce None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:54.215965 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ddd932-9788-422e-a02a-fb114ff1a4ce None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:54.216763 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ddd932-9788-422e-a02a-fb114ff1a4ce None admin] PATH_INFO: `/v3/projects/7086655a913e49b899fae73f13ec6c42` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:54.218276 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ddd932-9788-422e-a02a-fb114ff1a4ce None admin] RBAC: Authorizing `identity:get_project(project_id=7086655a913e49b899fae73f13ec6c42)` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:54.218393 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:54.220690 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ddd932-9788-422e-a02a-fb114ff1a4ce None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:54.223739 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 185/372] 10.222.0.62 () {56 vars in 1186 bytes} [Fri May 27 08:26:53 2022] GET /identity/v3/projects/7086655a913e49b899fae73f13ec6c42 => generated 302 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:26:54.225017 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ddd932-9788-422e-a02a-fb114ff1a4ce None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:54.238807 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92eb6fe-6d2e-4fa6-a15c-2c6072674f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:54.240986 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92eb6fe-6d2e-4fa6-a15c-2c6072674f80 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:54.241327 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92eb6fe-6d2e-4fa6-a15c-2c6072674f80 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:54.241568 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92eb6fe-6d2e-4fa6-a15c-2c6072674f80 None admin] PATH_INFO: `/v3/projects/db9f476e682c4ed795ebf3f955e975c9` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:54.244542 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92eb6fe-6d2e-4fa6-a15c-2c6072674f80 None admin] RBAC: Authorizing `identity:get_project(project_id=db9f476e682c4ed795ebf3f955e975c9)` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:54.245854 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92eb6fe-6d2e-4fa6-a15c-2c6072674f80 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:54.249576 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 188/373] 10.222.0.62 () {56 vars in 1186 bytes} [Fri May 27 08:26:54 2022] GET /identity/v3/projects/db9f476e682c4ed795ebf3f955e975c9 => generated 344 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:26:54.249754 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92eb6fe-6d2e-4fa6-a15c-2c6072674f80 None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:54.380729 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ddd932-9788-422e-a02a-fb114ff1a4ce None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:54.430128 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59647c23-a5c9-4abe-a987-973c178d5a28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:54.431929 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59647c23-a5c9-4abe-a987-973c178d5a28 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:54.432223 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59647c23-a5c9-4abe-a987-973c178d5a28 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:54.432509 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59647c23-a5c9-4abe-a987-973c178d5a28 None admin] PATH_INFO: `/v3/projects/7086655a913e49b899fae73f13ec6c42` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:54.433940 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92eb6fe-6d2e-4fa6-a15c-2c6072674f80 None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:54.434088 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59647c23-a5c9-4abe-a987-973c178d5a28 None admin] RBAC: Authorizing `identity:get_project(project_id=7086655a913e49b899fae73f13ec6c42)` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:54.435529 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59647c23-a5c9-4abe-a987-973c178d5a28 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:54.439368 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 186/374] 10.222.0.62 () {56 vars in 1186 bytes} [Fri May 27 08:26:54 2022] GET /identity/v3/projects/7086655a913e49b899fae73f13ec6c42 => generated 302 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:26:54.440959 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59647c23-a5c9-4abe-a987-973c178d5a28 None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:54.481740 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:54.488321 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e88c631-5bbf-4c32-9859-e5d3653863d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:54.489760 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e88c631-5bbf-4c32-9859-e5d3653863d6 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:54.490330 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e88c631-5bbf-4c32-9859-e5d3653863d6 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:54.490616 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e88c631-5bbf-4c32-9859-e5d3653863d6 None admin] PATH_INFO: `/v3/groups/1edbdb0d4e6e40bba8a9c900d741bc93` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:54.492862 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e88c631-5bbf-4c32-9859-e5d3653863d6 None admin] RBAC: Authorizing `identity:get_group(group_id=1edbdb0d4e6e40bba8a9c900d741bc93)` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:54.495400 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e88c631-5bbf-4c32-9859-e5d3653863d6 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:54.497513 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 189/375] 10.222.0.62 () {56 vars in 1180 bytes} [Fri May 27 08:26:54 2022] GET /identity/v3/groups/1edbdb0d4e6e40bba8a9c900d741bc93 => generated 226 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:26:54.498342 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e88c631-5bbf-4c32-9859-e5d3653863d6 None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:54.589348 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:54.595052 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59647c23-a5c9-4abe-a987-973c178d5a28 None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:54.645935 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e88c631-5bbf-4c32-9859-e5d3653863d6 None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:54.667111 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b91e0b-cdfe-4dfd-92f7-6e4bab805da8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:54.668204 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b91e0b-cdfe-4dfd-92f7-6e4bab805da8 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:54.668491 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b91e0b-cdfe-4dfd-92f7-6e4bab805da8 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:54.668803 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b91e0b-cdfe-4dfd-92f7-6e4bab805da8 None admin] PATH_INFO: `/v3/groups/8e5b8dac147e4726a6ef0eaf19d26824` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:54.680393 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b91e0b-cdfe-4dfd-92f7-6e4bab805da8 None admin] RBAC: Authorizing `identity:get_group(group_id=8e5b8dac147e4726a6ef0eaf19d26824)` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:54.682582 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b91e0b-cdfe-4dfd-92f7-6e4bab805da8 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:54.684886 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 187/376] 10.222.0.62 () {56 vars in 1180 bytes} [Fri May 27 08:26:54 2022] GET /identity/v3/groups/8e5b8dac147e4726a6ef0eaf19d26824 => generated 229 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:26:54.686008 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b91e0b-cdfe-4dfd-92f7-6e4bab805da8 None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:54.699166 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd407fa-473d-428a-b6c4-d86721a481d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:54.700006 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd407fa-473d-428a-b6c4-d86721a481d6 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:54.700287 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd407fa-473d-428a-b6c4-d86721a481d6 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:54.700562 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd407fa-473d-428a-b6c4-d86721a481d6 None admin] PATH_INFO: `/v3/groups/1edbdb0d4e6e40bba8a9c900d741bc93` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:54.702567 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd407fa-473d-428a-b6c4-d86721a481d6 None admin] RBAC: Authorizing `identity:get_group(group_id=1edbdb0d4e6e40bba8a9c900d741bc93)` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:54.704125 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd407fa-473d-428a-b6c4-d86721a481d6 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:54.707895 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 190/377] 10.222.0.62 () {56 vars in 1180 bytes} [Fri May 27 08:26:54 2022] GET /identity/v3/groups/1edbdb0d4e6e40bba8a9c900d741bc93 => generated 226 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:26:54.709781 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e597fc36-876c-4a0e-970d-5e61d394aafb None None] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:54.711508 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e597fc36-876c-4a0e-970d-5e61d394aafb None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:54.711508 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e597fc36-876c-4a0e-970d-5e61d394aafb None None] PATH_INFO: `/` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:54.712308 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 191/378] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:26:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:26:54.714890 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e597fc36-876c-4a0e-970d-5e61d394aafb None None] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:54.837480 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:54.868904 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b91e0b-cdfe-4dfd-92f7-6e4bab805da8 None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:54.923311 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e597fc36-876c-4a0e-970d-5e61d394aafb None None] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:54.927513 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a5e3e5-a2c0-494e-9e0a-1962199a5bf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:54.928267 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a5e3e5-a2c0-494e-9e0a-1962199a5bf8 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:54.928560 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a5e3e5-a2c0-494e-9e0a-1962199a5bf8 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:54.928901 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a5e3e5-a2c0-494e-9e0a-1962199a5bf8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:54.929765 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a5e3e5-a2c0-494e-9e0a-1962199a5bf8 None admin] RBAC: Adding query filter params (group.id=1edbdb0d4e6e40bba8a9c900d741bc93, role.id=9ff71fb5e7b7407d8d243eaa7da0a125, scope.project.id=7086655a913e49b899fae73f13ec6c42) {{(pid=87173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:26:54.930081 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a5e3e5-a2c0-494e-9e0a-1962199a5bf8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:54.931617 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a5e3e5-a2c0-494e-9e0a-1962199a5bf8 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:54.942845 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 188/379] 10.222.0.62 () {56 vars in 1376 bytes} [Fri May 27 08:26:54 2022] GET /identity/v3/role_assignments?group.id=1edbdb0d4e6e40bba8a9c900d741bc93&scope.project.id=7086655a913e49b899fae73f13ec6c42&role.id=9ff71fb5e7b7407d8d243eaa7da0a125 => generated 260 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:26:54.944039 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a5e3e5-a2c0-494e-9e0a-1962199a5bf8 None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:55.001193 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65807a0a-c098-45a1-acb1-7f57b9592953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:55.001917 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65807a0a-c098-45a1-acb1-7f57b9592953 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:55.002200 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65807a0a-c098-45a1-acb1-7f57b9592953 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:55.002476 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65807a0a-c098-45a1-acb1-7f57b9592953 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:55.004415 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65807a0a-c098-45a1-acb1-7f57b9592953 None admin] RBAC: Adding query filter params (group.id=8e5b8dac147e4726a6ef0eaf19d26824, role.id=5e6f243a7201412c965e7c70249d4dc0, scope.project.id=db9f476e682c4ed795ebf3f955e975c9) {{(pid=87172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:26:55.006292 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65807a0a-c098-45a1-acb1-7f57b9592953 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:55.006531 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65807a0a-c098-45a1-acb1-7f57b9592953 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:55.012189 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:55.029663 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 192/380] 10.222.0.62 () {56 vars in 1376 bytes} [Fri May 27 08:26:54 2022] GET /identity/v3/role_assignments?group.id=8e5b8dac147e4726a6ef0eaf19d26824&scope.project.id=db9f476e682c4ed795ebf3f955e975c9&role.id=5e6f243a7201412c965e7c70249d4dc0 => generated 260 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:26:55.032691 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c704d2-090b-4d81-96cf-2cdf88416eda None None] REQUEST_METHOD: `POST` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:55.033352 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c704d2-090b-4d81-96cf-2cdf88416eda None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:55.034077 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c704d2-090b-4d81-96cf-2cdf88416eda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:55.081565 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.auth.core [None req-73c704d2-090b-4d81-96cf-2cdf88416eda None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:26:55.085107 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.fernet_utils [None req-73c704d2-090b-4d81-96cf-2cdf88416eda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:26:55.229713 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a5e3e5-a2c0-494e-9e0a-1962199a5bf8 None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:55.278277 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 193/381] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:26:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 08:26:55.309128 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c704d2-090b-4d81-96cf-2cdf88416eda None None] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:55.317390 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd718e2-8668-4248-ae77-8b1be094c02e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:55.317825 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd718e2-8668-4248-ae77-8b1be094c02e None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:55.318119 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd718e2-8668-4248-ae77-8b1be094c02e None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:55.318396 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd718e2-8668-4248-ae77-8b1be094c02e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:55.319253 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd718e2-8668-4248-ae77-8b1be094c02e None admin] RBAC: Adding query filter params (group.id=1edbdb0d4e6e40bba8a9c900d741bc93, role.id=c980c64bb84b418daa012ae45a054b37, scope.project.id=7086655a913e49b899fae73f13ec6c42) {{(pid=87173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:26:55.319567 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd718e2-8668-4248-ae77-8b1be094c02e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:55.321182 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd718e2-8668-4248-ae77-8b1be094c02e None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:55.330778 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 189/382] 10.222.0.62 () {56 vars in 1376 bytes} [Fri May 27 08:26:54 2022] GET /identity/v3/role_assignments?group.id=1edbdb0d4e6e40bba8a9c900d741bc93&scope.project.id=7086655a913e49b899fae73f13ec6c42&role.id=c980c64bb84b418daa012ae45a054b37 => generated 260 bytes in 387 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:26:55.467850 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c704d2-090b-4d81-96cf-2cdf88416eda None None] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:55.510254 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:55.530870 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53cd248-bff4-4c29-b4ee-16bd0a4221e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:55.533545 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53cd248-bff4-4c29-b4ee-16bd0a4221e6 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:55.535248 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53cd248-bff4-4c29-b4ee-16bd0a4221e6 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:55.535792 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53cd248-bff4-4c29-b4ee-16bd0a4221e6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:55.563621 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53cd248-bff4-4c29-b4ee-16bd0a4221e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 08:26:55.580654 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application [None req-d53cd248-bff4-4c29-b4ee-16bd0a4221e6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 08:26:55.580654 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:26:55.580654 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:26:55.580654 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:26:55.580654 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:26:55.580654 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:26:55.580654 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:26:55.580654 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:26:55.580654 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:26:55.580654 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:26:55.580654 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:26:55.580654 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:26:55.580654 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 08:26:55.580654 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 08:26:55.580654 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 08:26:55.580654 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 08:26:55.582479 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 08:26:55.582479 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 08:26:55.582479 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 08:26:55.582479 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 08:26:55.582479 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:26:55.582479 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:26:55.582479 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:26:55.582479 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:26:55.582479 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:26:55.582479 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:26:55.582479 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:26:55.582479 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application with Lock( May 27 08:26:55.582479 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:26:55.582479 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._enter() May 27 08:26:55.582479 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:26:55.582479 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:26:55.583290 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:26:55.583290 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.creator() May 27 08:26:55.583290 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:26:55.583290 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application created_value = creator( May 27 08:26:55.583290 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 08:26:55.583290 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 08:26:55.583290 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 08:26:55.583290 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 08:26:55.583290 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 08:26:55.583290 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 08:26:55.583290 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 08:26:55.583290 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application May 27 08:26:55.586293 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 194/383] 10.222.0.62 () {56 vars in 1099 bytes} [Fri May 27 08:26:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 08:26:55.594817 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd718e2-8668-4248-ae77-8b1be094c02e None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:55.628014 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:55.777666 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd718e2-8668-4248-ae77-8b1be094c02e None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:55.818869 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639f329d-d5a1-4b16-b0e2-9909174786cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:55.819561 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639f329d-d5a1-4b16-b0e2-9909174786cf None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:55.819836 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639f329d-d5a1-4b16-b0e2-9909174786cf None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:55.820119 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639f329d-d5a1-4b16-b0e2-9909174786cf None admin] PATH_INFO: `/v3/roles` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:55.820929 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639f329d-d5a1-4b16-b0e2-9909174786cf None admin] RBAC: Adding query filter params (name=member) {{(pid=87173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:26:55.821239 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639f329d-d5a1-4b16-b0e2-9909174786cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:55.822678 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639f329d-d5a1-4b16-b0e2-9909174786cf None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:55.833176 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 190/384] 10.222.0.62 () {56 vars in 1101 bytes} [Fri May 27 08:26:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:26:55.842570 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53cd248-bff4-4c29-b4ee-16bd0a4221e6 None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:55.997065 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53cd248-bff4-4c29-b4ee-16bd0a4221e6 None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:56.006976 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b166281-f790-4671-8925-aa496ab21102 None None] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:56.007489 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b166281-f790-4671-8925-aa496ab21102 None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:56.008002 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b166281-f790-4671-8925-aa496ab21102 None None] PATH_INFO: `/` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:56.017227 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 191/385] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:26:56 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:26:56.027198 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3455712-bace-46a2-8c78-76d705e32145 None None] REQUEST_METHOD: `POST` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:56.027783 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3455712-bace-46a2-8c78-76d705e32145 None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:56.028239 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3455712-bace-46a2-8c78-76d705e32145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:56.040807 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66664a71-d280-4895-a243-fa4c8d37ecce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:56.041693 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66664a71-d280-4895-a243-fa4c8d37ecce None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:56.041986 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66664a71-d280-4895-a243-fa4c8d37ecce None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:56.042268 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66664a71-d280-4895-a243-fa4c8d37ecce None admin] PATH_INFO: `/v3/groups/1edbdb0d4e6e40bba8a9c900d741bc93` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:56.047371 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66664a71-d280-4895-a243-fa4c8d37ecce None admin] RBAC: Authorizing `identity:get_group(group_id=1edbdb0d4e6e40bba8a9c900d741bc93)` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:56.048916 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66664a71-d280-4895-a243-fa4c8d37ecce None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:56.056124 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.auth.core [None req-c3455712-bace-46a2-8c78-76d705e32145 None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:26:56.056843 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 195/386] 10.222.0.62 () {56 vars in 1180 bytes} [Fri May 27 08:26:55 2022] GET /identity/v3/groups/1edbdb0d4e6e40bba8a9c900d741bc93 => generated 226 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:26:56.057412 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.fernet_utils [None req-c3455712-bace-46a2-8c78-76d705e32145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:26:56.058028 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66664a71-d280-4895-a243-fa4c8d37ecce None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:56.135578 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:56.191726 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66664a71-d280-4895-a243-fa4c8d37ecce None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:56.233374 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7944b2e-afc6-4d81-a398-f16d3b9ce201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:56.234461 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7944b2e-afc6-4d81-a398-f16d3b9ce201 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:56.234753 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7944b2e-afc6-4d81-a398-f16d3b9ce201 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:56.235078 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7944b2e-afc6-4d81-a398-f16d3b9ce201 None admin] PATH_INFO: `/v3/projects/befb09928b604b3e89c10a3f78d3aede` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:56.236536 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7944b2e-afc6-4d81-a398-f16d3b9ce201 None admin] RBAC: Authorizing `identity:get_project(project_id=befb09928b604b3e89c10a3f78d3aede)` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:56.238543 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7944b2e-afc6-4d81-a398-f16d3b9ce201 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:56.240801 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 196/387] 10.222.0.62 () {56 vars in 1186 bytes} [Fri May 27 08:26:56 2022] GET /identity/v3/projects/befb09928b604b3e89c10a3f78d3aede => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 08:26:56.243490 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 192/388] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:26:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 08:26:56.249005 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7944b2e-afc6-4d81-a398-f16d3b9ce201 None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:56.364932 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3455712-bace-46a2-8c78-76d705e32145 None None] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:56.368350 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:56.496619 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3455712-bace-46a2-8c78-76d705e32145 None None] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:56.502484 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7944b2e-afc6-4d81-a398-f16d3b9ce201 None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:56.530318 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8820085-448b-47a6-bdc3-907368d34599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:56.530857 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8820085-448b-47a6-bdc3-907368d34599 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:56.531192 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8820085-448b-47a6-bdc3-907368d34599 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:56.531446 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8820085-448b-47a6-bdc3-907368d34599 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:56.546762 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8820085-448b-47a6-bdc3-907368d34599 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 08:26:56.562831 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application [None req-f8820085-448b-47a6-bdc3-907368d34599 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 08:26:56.562831 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:26:56.562831 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:26:56.562831 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:26:56.562831 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:26:56.562831 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:26:56.562831 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:26:56.562831 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:26:56.562831 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:26:56.562831 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:26:56.562831 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:26:56.562831 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:26:56.562831 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 08:26:56.562831 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 08:26:56.562831 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 08:26:56.562831 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 08:26:56.564634 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 08:26:56.564634 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 08:26:56.564634 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 08:26:56.564634 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 08:26:56.564634 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:26:56.564634 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:26:56.564634 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:26:56.564634 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:26:56.564634 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:26:56.564634 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:26:56.564634 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:26:56.564634 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application with Lock( May 27 08:26:56.564634 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:26:56.564634 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._enter() May 27 08:26:56.564634 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:26:56.564634 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:26:56.566308 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:26:56.566308 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.creator() May 27 08:26:56.566308 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:26:56.566308 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application created_value = creator( May 27 08:26:56.566308 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 08:26:56.566308 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 08:26:56.566308 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 08:26:56.566308 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 08:26:56.566308 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 08:26:56.566308 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 08:26:56.566308 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 08:26:56.566308 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application May 27 08:26:56.566308 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 193/389] 10.222.0.62 () {56 vars in 1114 bytes} [Fri May 27 08:26:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 08:26:56.566308 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8820085-448b-47a6-bdc3-907368d34599 None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:56.582029 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:56.613246 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afead3f3-2cb7-436b-b410-8f2bec89ce1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:56.614349 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afead3f3-2cb7-436b-b410-8f2bec89ce1f None admin] REQUEST_METHOD: `PUT` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:56.614722 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afead3f3-2cb7-436b-b410-8f2bec89ce1f None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:56.615595 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afead3f3-2cb7-436b-b410-8f2bec89ce1f None admin] PATH_INFO: `/v3/projects/befb09928b604b3e89c10a3f78d3aede/groups/1edbdb0d4e6e40bba8a9c900d741bc93/roles/c980c64bb84b418daa012ae45a054b37` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:56.622225 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afead3f3-2cb7-436b-b410-8f2bec89ce1f None admin] RBAC: Authorizing `identity:create_grant(project_id=befb09928b604b3e89c10a3f78d3aede, group_id=1edbdb0d4e6e40bba8a9c900d741bc93, role_id=c980c64bb84b418daa012ae45a054b37)` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:56.623817 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afead3f3-2cb7-436b-b410-8f2bec89ce1f None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:56.658630 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:56.665782 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 197/390] 10.222.0.62 () {58 vars in 1442 bytes} [Fri May 27 08:26:56 2022] PUT /identity/v3/projects/befb09928b604b3e89c10a3f78d3aede/groups/1edbdb0d4e6e40bba8a9c900d741bc93/roles/c980c64bb84b418daa012ae45a054b37 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 08:26:56.712316 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8820085-448b-47a6-bdc3-907368d34599 None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:56.755481 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff8c70c-0a73-43bd-b75b-d51f0ee6037b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:56.756574 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff8c70c-0a73-43bd-b75b-d51f0ee6037b None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:56.757092 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff8c70c-0a73-43bd-b75b-d51f0ee6037b None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:56.757563 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff8c70c-0a73-43bd-b75b-d51f0ee6037b None admin] PATH_INFO: `/v3/roles` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:56.758566 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff8c70c-0a73-43bd-b75b-d51f0ee6037b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:26:56.759082 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff8c70c-0a73-43bd-b75b-d51f0ee6037b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:56.760790 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff8c70c-0a73-43bd-b75b-d51f0ee6037b None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:56.772009 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 194/391] 10.222.0.62 () {56 vars in 1111 bytes} [Fri May 27 08:26:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:26:56.780639 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afead3f3-2cb7-436b-b410-8f2bec89ce1f None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:56.949655 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afead3f3-2cb7-436b-b410-8f2bec89ce1f None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:57.010914 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c5ce72-5e99-45fe-990f-3993a852ec19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:57.012477 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c5ce72-5e99-45fe-990f-3993a852ec19 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:57.013080 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c5ce72-5e99-45fe-990f-3993a852ec19 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:57.013889 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c5ce72-5e99-45fe-990f-3993a852ec19 None admin] PATH_INFO: `/v3/groups/1edbdb0d4e6e40bba8a9c900d741bc93` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:57.015911 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c5ce72-5e99-45fe-990f-3993a852ec19 None admin] RBAC: Authorizing `identity:get_group(group_id=1edbdb0d4e6e40bba8a9c900d741bc93)` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:57.019801 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c5ce72-5e99-45fe-990f-3993a852ec19 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:57.023045 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 198/392] 10.222.0.62 () {56 vars in 1180 bytes} [Fri May 27 08:26:56 2022] GET /identity/v3/groups/1edbdb0d4e6e40bba8a9c900d741bc93 => generated 226 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:26:57.031367 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff8c70c-0a73-43bd-b75b-d51f0ee6037b None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:57.191114 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff8c70c-0a73-43bd-b75b-d51f0ee6037b None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:57.240854 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:57.256706 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f92aec-de55-40ff-935e-a16777981a61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:57.258245 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f92aec-de55-40ff-935e-a16777981a61 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:57.258767 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f92aec-de55-40ff-935e-a16777981a61 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:57.259256 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f92aec-de55-40ff-935e-a16777981a61 None admin] PATH_INFO: `/v3/projects/befb09928b604b3e89c10a3f78d3aede` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:57.261533 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f92aec-de55-40ff-935e-a16777981a61 None admin] RBAC: Authorizing `identity:get_project(project_id=befb09928b604b3e89c10a3f78d3aede)` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:57.263807 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f92aec-de55-40ff-935e-a16777981a61 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:57.266148 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 195/393] 10.222.0.62 () {56 vars in 1186 bytes} [Fri May 27 08:26:57 2022] GET /identity/v3/projects/befb09928b604b3e89c10a3f78d3aede => generated 298 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:26:57.271998 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c5ce72-5e99-45fe-990f-3993a852ec19 None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:57.338159 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:57.402620 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c5ce72-5e99-45fe-990f-3993a852ec19 None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:57.451176 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8266ade4-ff6c-48d2-bf59-4083919e7fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:57.452065 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8266ade4-ff6c-48d2-bf59-4083919e7fb4 None admin] REQUEST_METHOD: `PUT` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:57.452348 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8266ade4-ff6c-48d2-bf59-4083919e7fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:57.452649 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8266ade4-ff6c-48d2-bf59-4083919e7fb4 None admin] PATH_INFO: `/v3/projects/befb09928b604b3e89c10a3f78d3aede/groups/1edbdb0d4e6e40bba8a9c900d741bc93/roles/9ff71fb5e7b7407d8d243eaa7da0a125` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:57.458071 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8266ade4-ff6c-48d2-bf59-4083919e7fb4 None admin] RBAC: Authorizing `identity:create_grant(project_id=befb09928b604b3e89c10a3f78d3aede, group_id=1edbdb0d4e6e40bba8a9c900d741bc93, role_id=9ff71fb5e7b7407d8d243eaa7da0a125)` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:57.459533 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8266ade4-ff6c-48d2-bf59-4083919e7fb4 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:57.481620 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 199/394] 10.222.0.62 () {58 vars in 1442 bytes} [Fri May 27 08:26:57 2022] PUT /identity/v3/projects/befb09928b604b3e89c10a3f78d3aede/groups/1edbdb0d4e6e40bba8a9c900d741bc93/roles/9ff71fb5e7b7407d8d243eaa7da0a125 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 08:26:58.197705 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977197a7-1cc7-4d7b-830d-de6c7d8e3caf None None] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:58.198248 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977197a7-1cc7-4d7b-830d-de6c7d8e3caf None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:58.198248 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977197a7-1cc7-4d7b-830d-de6c7d8e3caf None None] PATH_INFO: `/` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:58.200059 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 196/395] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:26:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:26:58.207229 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f36665b-adaf-4b20-9086-c7e268585245 None None] REQUEST_METHOD: `POST` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:58.207775 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f36665b-adaf-4b20-9086-c7e268585245 None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:58.208087 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f36665b-adaf-4b20-9086-c7e268585245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:58.232849 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.auth.core [None req-9f36665b-adaf-4b20-9086-c7e268585245 None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:26:58.234089 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.fernet_utils [None req-9f36665b-adaf-4b20-9086-c7e268585245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:26:58.338877 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 200/396] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:26:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 08:26:58.374935 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977197a7-1cc7-4d7b-830d-de6c7d8e3caf None None] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:58.475533 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ce6d5b-2c8e-4e99-96a2-dc5bf8436348 None None] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:58.475825 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ce6d5b-2c8e-4e99-96a2-dc5bf8436348 None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:58.476016 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ce6d5b-2c8e-4e99-96a2-dc5bf8436348 None None] PATH_INFO: `/` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:58.477425 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 201/397] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:26:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 08:26:58.483197 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9e3b03-2c3e-4fea-867f-8625eda03a8f None None] REQUEST_METHOD: `POST` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:58.483486 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9e3b03-2c3e-4fea-867f-8625eda03a8f None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:58.483767 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9e3b03-2c3e-4fea-867f-8625eda03a8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:58.510865 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.auth.core [None req-2f9e3b03-2c3e-4fea-867f-8625eda03a8f None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:26:58.512073 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.fernet_utils [None req-2f9e3b03-2c3e-4fea-867f-8625eda03a8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:26:58.563951 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977197a7-1cc7-4d7b-830d-de6c7d8e3caf None None] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:58.572134 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:58.622308 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef057e0-3a5a-4ee9-9a15-5c5c0ca6fc90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:58.623109 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef057e0-3a5a-4ee9-9a15-5c5c0ca6fc90 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:58.623392 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef057e0-3a5a-4ee9-9a15-5c5c0ca6fc90 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:58.623670 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef057e0-3a5a-4ee9-9a15-5c5c0ca6fc90 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:58.633358 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 202/398] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:26:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 08:26:58.635027 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce7abc6-473a-4154-8d4c-2d32ee195462 None None] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:58.635511 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce7abc6-473a-4154-8d4c-2d32ee195462 None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:58.640628 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce7abc6-473a-4154-8d4c-2d32ee195462 None None] PATH_INFO: `/` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:58.642573 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 203/399] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:26:58 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:26:58.645534 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef057e0-3a5a-4ee9-9a15-5c5c0ca6fc90 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 08:26:58.653689 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application [None req-3ef057e0-3a5a-4ee9-9a15-5c5c0ca6fc90 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 08:26:58.653689 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:26:58.653689 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:26:58.653689 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:26:58.653689 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:26:58.653689 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:26:58.653689 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:26:58.653689 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:26:58.653689 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:26:58.653689 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:26:58.653689 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:26:58.653689 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:26:58.653689 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 08:26:58.653689 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 08:26:58.653689 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 08:26:58.653689 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 08:26:58.654576 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 08:26:58.654576 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 08:26:58.654576 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 08:26:58.654576 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 08:26:58.654576 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:26:58.654576 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:26:58.654576 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:26:58.654576 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:26:58.654576 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:26:58.654576 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:26:58.654576 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:26:58.654576 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application with Lock( May 27 08:26:58.654576 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:26:58.654576 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._enter() May 27 08:26:58.654576 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:26:58.654576 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:26:58.655376 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:26:58.655376 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.creator() May 27 08:26:58.655376 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:26:58.655376 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application created_value = creator( May 27 08:26:58.655376 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 08:26:58.655376 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 08:26:58.655376 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 08:26:58.655376 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 08:26:58.655376 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 08:26:58.655376 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 08:26:58.655376 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 08:26:58.655376 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application May 27 08:26:58.655982 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42c35db-b860-4143-b621-083f1a55d7a0 None None] REQUEST_METHOD: `POST` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:58.655982 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42c35db-b860-4143-b621-083f1a55d7a0 None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:58.655982 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42c35db-b860-4143-b621-083f1a55d7a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:58.658145 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 197/400] 10.222.0.62 () {56 vars in 1096 bytes} [Fri May 27 08:26:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 08:26:58.669637 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef057e0-3a5a-4ee9-9a15-5c5c0ca6fc90 None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:58.678079 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.auth.core [None req-a42c35db-b860-4143-b621-083f1a55d7a0 None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:26:58.679295 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.fernet_utils [None req-a42c35db-b860-4143-b621-083f1a55d7a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:26:58.754709 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:58.756762 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 204/401] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:26:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 08:26:58.757846 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42c35db-b860-4143-b621-083f1a55d7a0 None None] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:58.809083 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef057e0-3a5a-4ee9-9a15-5c5c0ca6fc90 None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:58.852539 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bffc9ff-e3cf-4ab7-a48e-3aefd7299f01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:58.853575 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bffc9ff-e3cf-4ab7-a48e-3aefd7299f01 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:58.854008 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bffc9ff-e3cf-4ab7-a48e-3aefd7299f01 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:58.854430 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bffc9ff-e3cf-4ab7-a48e-3aefd7299f01 None admin] PATH_INFO: `/v3/roles` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:58.855330 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bffc9ff-e3cf-4ab7-a48e-3aefd7299f01 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:26:58.855783 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bffc9ff-e3cf-4ab7-a48e-3aefd7299f01 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:58.857412 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bffc9ff-e3cf-4ab7-a48e-3aefd7299f01 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:58.867449 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 198/402] 10.222.0.62 () {56 vars in 1099 bytes} [Fri May 27 08:26:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:26:58.873700 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bffc9ff-e3cf-4ab7-a48e-3aefd7299f01 None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:58.903808 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42c35db-b860-4143-b621-083f1a55d7a0 None None] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:58.905538 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:58.946444 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a8e17d-9c91-473f-9379-6ab35c48b448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:58.947258 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a8e17d-9c91-473f-9379-6ab35c48b448 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:58.947544 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a8e17d-9c91-473f-9379-6ab35c48b448 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:58.947819 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a8e17d-9c91-473f-9379-6ab35c48b448 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:58.959247 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a8e17d-9c91-473f-9379-6ab35c48b448 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 08:26:58.967614 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application [None req-69a8e17d-9c91-473f-9379-6ab35c48b448 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 08:26:58.967614 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:26:58.967614 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:26:58.967614 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:26:58.967614 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:26:58.967614 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:26:58.967614 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:26:58.967614 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:26:58.967614 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:26:58.967614 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:26:58.967614 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:26:58.967614 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:26:58.967614 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 08:26:58.967614 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 08:26:58.967614 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 08:26:58.967614 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 08:26:58.968529 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 08:26:58.968529 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 08:26:58.968529 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 08:26:58.968529 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 08:26:58.968529 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:26:58.968529 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:26:58.968529 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:26:58.968529 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:26:58.968529 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:26:58.968529 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:26:58.968529 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:26:58.968529 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application with Lock( May 27 08:26:58.968529 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:26:58.968529 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._enter() May 27 08:26:58.968529 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:26:58.968529 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:26:58.969384 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:26:58.969384 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.creator() May 27 08:26:58.969384 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:26:58.969384 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application created_value = creator( May 27 08:26:58.969384 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 08:26:58.969384 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 08:26:58.969384 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 08:26:58.969384 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 08:26:58.969384 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 08:26:58.969384 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 08:26:58.969384 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 08:26:58.969384 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application May 27 08:26:58.972968 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 205/403] 10.222.0.62 () {56 vars in 1114 bytes} [Fri May 27 08:26:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 08:26:58.973917 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a8e17d-9c91-473f-9379-6ab35c48b448 None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:59.006649 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bffc9ff-e3cf-4ab7-a48e-3aefd7299f01 None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:59.025994 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:59.048145 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb4da76-6c9f-4dd5-8a38-00bc84da782b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:59.048984 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb4da76-6c9f-4dd5-8a38-00bc84da782b None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:59.049417 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb4da76-6c9f-4dd5-8a38-00bc84da782b None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:59.049700 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb4da76-6c9f-4dd5-8a38-00bc84da782b None admin] PATH_INFO: `/v3/roles/member` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:59.065844 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb4da76-6c9f-4dd5-8a38-00bc84da782b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 08:26:59.075925 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application [None req-5cb4da76-6c9f-4dd5-8a38-00bc84da782b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 08:26:59.075925 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:26:59.075925 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:26:59.075925 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:26:59.075925 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:26:59.075925 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:26:59.075925 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:26:59.075925 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:26:59.075925 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:26:59.075925 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:26:59.075925 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:26:59.075925 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:26:59.075925 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 08:26:59.075925 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 08:26:59.075925 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 08:26:59.075925 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 08:26:59.076941 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 08:26:59.076941 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 08:26:59.076941 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 08:26:59.076941 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 08:26:59.076941 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:26:59.076941 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:26:59.076941 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:26:59.076941 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:26:59.076941 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:26:59.076941 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:26:59.076941 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:26:59.076941 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application with Lock( May 27 08:26:59.076941 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:26:59.076941 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._enter() May 27 08:26:59.076941 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:26:59.076941 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:26:59.077765 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:26:59.077765 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.creator() May 27 08:26:59.077765 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:26:59.077765 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application created_value = creator( May 27 08:26:59.077765 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 08:26:59.077765 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 08:26:59.077765 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 08:26:59.077765 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 08:26:59.077765 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 08:26:59.077765 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 08:26:59.077765 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 08:26:59.077765 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application May 27 08:26:59.080781 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 199/404] 10.222.0.62 () {56 vars in 1099 bytes} [Fri May 27 08:26:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 08:26:59.081860 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb4da76-6c9f-4dd5-8a38-00bc84da782b None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:59.122602 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a8e17d-9c91-473f-9379-6ab35c48b448 None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:59.167487 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9e9e81-b999-43e1-b61f-a24611dcc55a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:59.168768 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9e9e81-b999-43e1-b61f-a24611dcc55a None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:59.169282 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9e9e81-b999-43e1-b61f-a24611dcc55a None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:59.169884 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9e9e81-b999-43e1-b61f-a24611dcc55a None admin] PATH_INFO: `/v3/groups/8e5b8dac147e4726a6ef0eaf19d26824` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:59.171276 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9e9e81-b999-43e1-b61f-a24611dcc55a None admin] RBAC: Authorizing `identity:get_group(group_id=8e5b8dac147e4726a6ef0eaf19d26824)` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:59.172982 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9e9e81-b999-43e1-b61f-a24611dcc55a None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:59.174910 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 206/405] 10.222.0.62 () {56 vars in 1180 bytes} [Fri May 27 08:26:58 2022] GET /identity/v3/groups/8e5b8dac147e4726a6ef0eaf19d26824 => generated 229 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:26:59.175912 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9e9e81-b999-43e1-b61f-a24611dcc55a None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:59.210116 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:59.222235 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb4da76-6c9f-4dd5-8a38-00bc84da782b None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:59.260618 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cfe566-265b-47cc-8579-dfbe40dced85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:59.261212 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cfe566-265b-47cc-8579-dfbe40dced85 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:59.261492 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cfe566-265b-47cc-8579-dfbe40dced85 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:59.261768 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cfe566-265b-47cc-8579-dfbe40dced85 None admin] PATH_INFO: `/v3/roles` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:59.262515 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cfe566-265b-47cc-8579-dfbe40dced85 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:26:59.263283 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cfe566-265b-47cc-8579-dfbe40dced85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:59.264312 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cfe566-265b-47cc-8579-dfbe40dced85 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:59.279860 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 200/406] 10.222.0.62 () {56 vars in 1111 bytes} [Fri May 27 08:26:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:26:59.279860 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cfe566-265b-47cc-8579-dfbe40dced85 None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:59.297827 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9e9e81-b999-43e1-b61f-a24611dcc55a None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:59.328247 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:59.338933 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4fd7aa-8418-4f7e-8c2e-cbe6c7711dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:59.340022 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4fd7aa-8418-4f7e-8c2e-cbe6c7711dc7 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:59.340518 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4fd7aa-8418-4f7e-8c2e-cbe6c7711dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:59.341066 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4fd7aa-8418-4f7e-8c2e-cbe6c7711dc7 None admin] PATH_INFO: `/v3/roles` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:59.342053 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4fd7aa-8418-4f7e-8c2e-cbe6c7711dc7 None admin] RBAC: Adding query filter params (name=member) {{(pid=87172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:26:59.342575 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4fd7aa-8418-4f7e-8c2e-cbe6c7711dc7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:59.344291 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4fd7aa-8418-4f7e-8c2e-cbe6c7711dc7 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:59.355137 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 207/407] 10.222.0.62 () {56 vars in 1101 bytes} [Fri May 27 08:26:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:26:59.356355 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4fd7aa-8418-4f7e-8c2e-cbe6c7711dc7 None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:59.402855 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cfe566-265b-47cc-8579-dfbe40dced85 None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:59.447208 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cac9f2-37ae-409b-a077-86729b548e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:59.448085 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cac9f2-37ae-409b-a077-86729b548e51 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:59.448367 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cac9f2-37ae-409b-a077-86729b548e51 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:59.448784 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cac9f2-37ae-409b-a077-86729b548e51 None admin] PATH_INFO: `/v3/projects/db9f476e682c4ed795ebf3f955e975c9` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:59.451036 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cac9f2-37ae-409b-a077-86729b548e51 None admin] RBAC: Authorizing `identity:get_project(project_id=db9f476e682c4ed795ebf3f955e975c9)` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:59.452020 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cac9f2-37ae-409b-a077-86729b548e51 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:59.454088 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 201/408] 10.222.0.62 () {56 vars in 1186 bytes} [Fri May 27 08:26:59 2022] GET /identity/v3/projects/db9f476e682c4ed795ebf3f955e975c9 => generated 344 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:26:59.454933 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cac9f2-37ae-409b-a077-86729b548e51 None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:59.462786 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:59.473855 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4fd7aa-8418-4f7e-8c2e-cbe6c7711dc7 None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:59.512072 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dea96d-b78e-4c20-8aae-69ccd137f1a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:59.513463 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dea96d-b78e-4c20-8aae-69ccd137f1a6 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:59.513978 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dea96d-b78e-4c20-8aae-69ccd137f1a6 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:59.514457 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dea96d-b78e-4c20-8aae-69ccd137f1a6 None admin] PATH_INFO: `/v3/groups/1edbdb0d4e6e40bba8a9c900d741bc93` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:59.515917 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dea96d-b78e-4c20-8aae-69ccd137f1a6 None admin] RBAC: Authorizing `identity:get_group(group_id=1edbdb0d4e6e40bba8a9c900d741bc93)` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:59.517692 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dea96d-b78e-4c20-8aae-69ccd137f1a6 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:59.519716 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 208/409] 10.222.0.62 () {56 vars in 1180 bytes} [Fri May 27 08:26:59 2022] GET /identity/v3/groups/1edbdb0d4e6e40bba8a9c900d741bc93 => generated 226 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:26:59.520844 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dea96d-b78e-4c20-8aae-69ccd137f1a6 None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:59.568791 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cac9f2-37ae-409b-a077-86729b548e51 None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:59.578714 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:59.612318 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfe0f4e-7940-4992-b5d4-3152173971e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:59.613337 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfe0f4e-7940-4992-b5d4-3152173971e1 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:59.613476 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfe0f4e-7940-4992-b5d4-3152173971e1 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:59.613776 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfe0f4e-7940-4992-b5d4-3152173971e1 None admin] PATH_INFO: `/v3/groups/1edbdb0d4e6e40bba8a9c900d741bc93` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:59.615020 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfe0f4e-7940-4992-b5d4-3152173971e1 None admin] RBAC: Authorizing `identity:get_group(group_id=1edbdb0d4e6e40bba8a9c900d741bc93)` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:59.616664 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfe0f4e-7940-4992-b5d4-3152173971e1 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:59.625740 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 202/410] 10.222.0.62 () {56 vars in 1180 bytes} [Fri May 27 08:26:59 2022] GET /identity/v3/groups/1edbdb0d4e6e40bba8a9c900d741bc93 => generated 226 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:26:59.625740 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfe0f4e-7940-4992-b5d4-3152173971e1 None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:59.648680 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dea96d-b78e-4c20-8aae-69ccd137f1a6 None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:59.689409 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c548dc4d-9522-490b-86d9-74d7d04cec50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:59.690859 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c548dc4d-9522-490b-86d9-74d7d04cec50 None admin] REQUEST_METHOD: `PUT` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:59.691139 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c548dc4d-9522-490b-86d9-74d7d04cec50 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:59.691419 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c548dc4d-9522-490b-86d9-74d7d04cec50 None admin] PATH_INFO: `/v3/projects/db9f476e682c4ed795ebf3f955e975c9/groups/8e5b8dac147e4726a6ef0eaf19d26824/roles/5e6f243a7201412c965e7c70249d4dc0` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:59.693544 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c548dc4d-9522-490b-86d9-74d7d04cec50 None admin] RBAC: Authorizing `identity:create_grant(project_id=db9f476e682c4ed795ebf3f955e975c9, group_id=8e5b8dac147e4726a6ef0eaf19d26824, role_id=5e6f243a7201412c965e7c70249d4dc0)` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:59.695014 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c548dc4d-9522-490b-86d9-74d7d04cec50 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:59.710482 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 209/411] 10.222.0.62 () {58 vars in 1442 bytes} [Fri May 27 08:26:59 2022] PUT /identity/v3/projects/db9f476e682c4ed795ebf3f955e975c9/groups/8e5b8dac147e4726a6ef0eaf19d26824/roles/5e6f243a7201412c965e7c70249d4dc0 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 08:26:59.711668 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bf117d-5ba8-42db-aace-1f5f7fd9dfa4 None None] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:59.711965 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bf117d-5ba8-42db-aace-1f5f7fd9dfa4 None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:59.712664 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bf117d-5ba8-42db-aace-1f5f7fd9dfa4 None None] PATH_INFO: `/` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:59.713757 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 210/412] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:26:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:26:59.714342 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bf117d-5ba8-42db-aace-1f5f7fd9dfa4 None None] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:59.761271 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:59.764936 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfe0f4e-7940-4992-b5d4-3152173971e1 None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:59.818552 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5808534-c59c-4162-9491-214e44b904d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:59.819522 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5808534-c59c-4162-9491-214e44b904d7 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:59.819830 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5808534-c59c-4162-9491-214e44b904d7 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:59.820120 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5808534-c59c-4162-9491-214e44b904d7 None admin] PATH_INFO: `/v3/projects/7086655a913e49b899fae73f13ec6c42` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:59.821828 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5808534-c59c-4162-9491-214e44b904d7 None admin] RBAC: Authorizing `identity:get_project(project_id=7086655a913e49b899fae73f13ec6c42)` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:59.823686 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5808534-c59c-4162-9491-214e44b904d7 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:59.825664 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 203/413] 10.222.0.62 () {56 vars in 1186 bytes} [Fri May 27 08:26:59 2022] GET /identity/v3/projects/7086655a913e49b899fae73f13ec6c42 => generated 302 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:26:59.827088 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dfa10b-ac9d-4766-ace3-a7f68be0e0b3 None None] REQUEST_METHOD: `POST` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:59.827306 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dfa10b-ac9d-4766-ace3-a7f68be0e0b3 None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:59.827593 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dfa10b-ac9d-4766-ace3-a7f68be0e0b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:59.848418 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.auth.core [None req-45dfa10b-ac9d-4766-ace3-a7f68be0e0b3 None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:26:59.850380 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.fernet_utils [None req-45dfa10b-ac9d-4766-ace3-a7f68be0e0b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:26:59.881843 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bf117d-5ba8-42db-aace-1f5f7fd9dfa4 None None] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:26:59.898087 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:26:59.923505 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaebc930-5b02-41fd-b8b3-94b2c40c90a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:26:59.924566 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaebc930-5b02-41fd-b8b3-94b2c40c90a4 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:26:59.925084 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaebc930-5b02-41fd-b8b3-94b2c40c90a4 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:26:59.925414 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaebc930-5b02-41fd-b8b3-94b2c40c90a4 None admin] PATH_INFO: `/v3/projects/7086655a913e49b899fae73f13ec6c42` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:26:59.927643 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaebc930-5b02-41fd-b8b3-94b2c40c90a4 None admin] RBAC: Authorizing `identity:get_project(project_id=7086655a913e49b899fae73f13ec6c42)` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:26:59.929144 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaebc930-5b02-41fd-b8b3-94b2c40c90a4 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:26:59.930912 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 211/414] 10.222.0.62 () {56 vars in 1186 bytes} [Fri May 27 08:26:59 2022] GET /identity/v3/projects/7086655a913e49b899fae73f13ec6c42 => generated 302 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:26:59.931621 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaebc930-5b02-41fd-b8b3-94b2c40c90a4 None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:26:59.936717 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 204/415] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:26:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 08:26:59.937431 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dfa10b-ac9d-4766-ace3-a7f68be0e0b3 None None] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:00.046028 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:00.060254 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaebc930-5b02-41fd-b8b3-94b2c40c90a4 None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:00.074292 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dfa10b-ac9d-4766-ace3-a7f68be0e0b3 None None] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:00.106851 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4245d87c-bd62-43a2-98e6-3a5ff4e70e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:00.108779 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4245d87c-bd62-43a2-98e6-3a5ff4e70e02 None admin] REQUEST_METHOD: `PUT` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:00.109590 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4245d87c-bd62-43a2-98e6-3a5ff4e70e02 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:00.110077 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4245d87c-bd62-43a2-98e6-3a5ff4e70e02 None admin] PATH_INFO: `/v3/projects/7086655a913e49b899fae73f13ec6c42/groups/1edbdb0d4e6e40bba8a9c900d741bc93/roles/9ff71fb5e7b7407d8d243eaa7da0a125` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:00.113258 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4245d87c-bd62-43a2-98e6-3a5ff4e70e02 None admin] RBAC: Authorizing `identity:create_grant(project_id=7086655a913e49b899fae73f13ec6c42, group_id=1edbdb0d4e6e40bba8a9c900d741bc93, role_id=9ff71fb5e7b7407d8d243eaa7da0a125)` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:00.113942 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47db426e-9d10-4206-b2eb-85fe75626aa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:00.114836 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47db426e-9d10-4206-b2eb-85fe75626aa0 None admin] REQUEST_METHOD: `PUT` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:00.115115 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47db426e-9d10-4206-b2eb-85fe75626aa0 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:00.115387 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47db426e-9d10-4206-b2eb-85fe75626aa0 None admin] PATH_INFO: `/v3/projects/7086655a913e49b899fae73f13ec6c42/groups/1edbdb0d4e6e40bba8a9c900d741bc93/roles/c980c64bb84b418daa012ae45a054b37` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:00.115886 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4245d87c-bd62-43a2-98e6-3a5ff4e70e02 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:00.117399 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47db426e-9d10-4206-b2eb-85fe75626aa0 None admin] RBAC: Authorizing `identity:create_grant(project_id=7086655a913e49b899fae73f13ec6c42, group_id=1edbdb0d4e6e40bba8a9c900d741bc93, role_id=c980c64bb84b418daa012ae45a054b37)` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:00.118963 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47db426e-9d10-4206-b2eb-85fe75626aa0 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:00.133814 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 212/416] 10.222.0.62 () {58 vars in 1442 bytes} [Fri May 27 08:26:59 2022] PUT /identity/v3/projects/7086655a913e49b899fae73f13ec6c42/groups/1edbdb0d4e6e40bba8a9c900d741bc93/roles/9ff71fb5e7b7407d8d243eaa7da0a125 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 08:27:00.134968 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4245d87c-bd62-43a2-98e6-3a5ff4e70e02 None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:00.137819 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 205/417] 10.222.0.62 () {58 vars in 1442 bytes} [Fri May 27 08:26:59 2022] PUT /identity/v3/projects/7086655a913e49b899fae73f13ec6c42/groups/1edbdb0d4e6e40bba8a9c900d741bc93/roles/c980c64bb84b418daa012ae45a054b37 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 08:27:00.325367 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4245d87c-bd62-43a2-98e6-3a5ff4e70e02 None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:00.325970 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e68f8de-4cf7-4cdb-89aa-e4aea2fc7a31 None None] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:00.326320 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e68f8de-4cf7-4cdb-89aa-e4aea2fc7a31 None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:00.326574 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e68f8de-4cf7-4cdb-89aa-e4aea2fc7a31 None None] PATH_INFO: `/` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:00.329696 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 206/418] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:27:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 08:27:00.334569 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1163c01d-95d9-4e05-b102-7043bbcfc00c None None] REQUEST_METHOD: `POST` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:00.334910 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1163c01d-95d9-4e05-b102-7043bbcfc00c None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:00.335140 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1163c01d-95d9-4e05-b102-7043bbcfc00c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:00.353955 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.auth.core [None req-1163c01d-95d9-4e05-b102-7043bbcfc00c None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:27:00.355183 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.fernet_utils [None req-1163c01d-95d9-4e05-b102-7043bbcfc00c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:27:00.386944 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de373dc9-85f1-4195-89fd-d850010b47d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:00.389093 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de373dc9-85f1-4195-89fd-d850010b47d9 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:00.389689 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de373dc9-85f1-4195-89fd-d850010b47d9 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:00.390160 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de373dc9-85f1-4195-89fd-d850010b47d9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:00.391575 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:00.408739 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de373dc9-85f1-4195-89fd-d850010b47d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 08:27:00.417296 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application [None req-de373dc9-85f1-4195-89fd-d850010b47d9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 08:27:00.417296 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:27:00.417296 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:27:00.417296 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:27:00.417296 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:27:00.417296 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:27:00.417296 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:27:00.417296 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:27:00.417296 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:27:00.417296 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:27:00.417296 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:27:00.417296 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:27:00.417296 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 08:27:00.417296 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 08:27:00.417296 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 08:27:00.417296 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 08:27:00.418257 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 08:27:00.418257 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 08:27:00.418257 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 08:27:00.418257 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 08:27:00.418257 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:27:00.418257 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:27:00.418257 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:27:00.418257 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:27:00.418257 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:27:00.418257 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:27:00.418257 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:27:00.418257 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application with Lock( May 27 08:27:00.418257 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:27:00.418257 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._enter() May 27 08:27:00.418257 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:27:00.418257 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:27:00.419064 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:27:00.419064 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.creator() May 27 08:27:00.419064 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:27:00.419064 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application created_value = creator( May 27 08:27:00.419064 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 08:27:00.419064 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 08:27:00.419064 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 08:27:00.419064 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 08:27:00.419064 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 08:27:00.419064 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 08:27:00.419064 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 08:27:00.419064 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application May 27 08:27:00.421198 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 213/419] 10.222.0.62 () {56 vars in 1099 bytes} [Fri May 27 08:27:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 08:27:00.430762 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de373dc9-85f1-4195-89fd-d850010b47d9 None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:00.446315 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:00.458744 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 207/420] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:27:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 08:27:00.492360 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1163c01d-95d9-4e05-b102-7043bbcfc00c None None] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:00.624207 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de373dc9-85f1-4195-89fd-d850010b47d9 None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:00.700260 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ae5cb0-cf48-495a-89f4-7c758b2c8a1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:00.700969 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ae5cb0-cf48-495a-89f4-7c758b2c8a1a None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:00.701256 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ae5cb0-cf48-495a-89f4-7c758b2c8a1a None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:00.701536 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ae5cb0-cf48-495a-89f4-7c758b2c8a1a None admin] PATH_INFO: `/v3/roles` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:00.702319 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ae5cb0-cf48-495a-89f4-7c758b2c8a1a None admin] RBAC: Adding query filter params (name=member) {{(pid=87172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:27:00.702628 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ae5cb0-cf48-495a-89f4-7c758b2c8a1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:00.704036 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ae5cb0-cf48-495a-89f4-7c758b2c8a1a None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:00.716814 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1163c01d-95d9-4e05-b102-7043bbcfc00c None None] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:00.723531 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 214/421] 10.222.0.62 () {56 vars in 1101 bytes} [Fri May 27 08:27:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 08:27:00.732685 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ae5cb0-cf48-495a-89f4-7c758b2c8a1a None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:00.813428 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:00.814307 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e3ed91-bcaf-4216-a46e-f2fea45e9c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:00.816080 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e3ed91-bcaf-4216-a46e-f2fea45e9c51 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:00.817028 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e3ed91-bcaf-4216-a46e-f2fea45e9c51 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:00.817784 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e3ed91-bcaf-4216-a46e-f2fea45e9c51 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:00.853614 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e3ed91-bcaf-4216-a46e-f2fea45e9c51 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 08:27:00.855994 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ae5cb0-cf48-495a-89f4-7c758b2c8a1a None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:00.872624 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application [None req-35e3ed91-bcaf-4216-a46e-f2fea45e9c51 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 08:27:00.872624 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:27:00.872624 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:27:00.872624 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:27:00.872624 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:27:00.872624 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:27:00.872624 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:27:00.872624 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:27:00.872624 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:27:00.872624 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:27:00.872624 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:27:00.872624 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:27:00.872624 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 08:27:00.872624 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 08:27:00.872624 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 08:27:00.872624 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 08:27:00.873606 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 08:27:00.873606 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 08:27:00.873606 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 08:27:00.873606 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 08:27:00.873606 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:27:00.873606 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:27:00.873606 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:27:00.873606 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:27:00.873606 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:27:00.873606 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:27:00.873606 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:27:00.873606 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application with Lock( May 27 08:27:00.873606 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:27:00.873606 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._enter() May 27 08:27:00.873606 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:27:00.873606 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:27:00.874444 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:27:00.874444 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.creator() May 27 08:27:00.874444 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:27:00.874444 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application created_value = creator( May 27 08:27:00.874444 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 08:27:00.874444 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 08:27:00.874444 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 08:27:00.874444 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 08:27:00.874444 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 08:27:00.874444 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 08:27:00.874444 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 08:27:00.874444 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application May 27 08:27:00.877391 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 208/422] 10.222.0.62 () {56 vars in 1114 bytes} [Fri May 27 08:27:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 385 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 08:27:00.894521 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e3ed91-bcaf-4216-a46e-f2fea45e9c51 None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:00.903361 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f989921a-3db9-4bd3-b190-a0ee2cb05ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:00.904042 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f989921a-3db9-4bd3-b190-a0ee2cb05ed4 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:00.904397 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f989921a-3db9-4bd3-b190-a0ee2cb05ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:00.904687 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f989921a-3db9-4bd3-b190-a0ee2cb05ed4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:00.947133 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:01.039927 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f989921a-3db9-4bd3-b190-a0ee2cb05ed4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:01.041424 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f989921a-3db9-4bd3-b190-a0ee2cb05ed4 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:01.121267 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:01.126870 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e3ed91-bcaf-4216-a46e-f2fea45e9c51 None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:01.156884 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 215/423] 10.222.0.62 () {58 vars in 1282 bytes} [Fri May 27 08:27:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 08:27:01.165791 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f989921a-3db9-4bd3-b190-a0ee2cb05ed4 None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:01.240551 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49b0481-8690-4802-9aaa-08902c5d380b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:01.241292 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49b0481-8690-4802-9aaa-08902c5d380b None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:01.241575 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49b0481-8690-4802-9aaa-08902c5d380b None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:01.241853 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49b0481-8690-4802-9aaa-08902c5d380b None admin] PATH_INFO: `/v3/roles` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:01.242905 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49b0481-8690-4802-9aaa-08902c5d380b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:27:01.243212 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49b0481-8690-4802-9aaa-08902c5d380b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:01.244936 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49b0481-8690-4802-9aaa-08902c5d380b None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:01.270651 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 209/424] 10.222.0.62 () {56 vars in 1111 bytes} [Fri May 27 08:27:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 377 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 08:27:01.276559 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49b0481-8690-4802-9aaa-08902c5d380b None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:01.301493 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f989921a-3db9-4bd3-b190-a0ee2cb05ed4 None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:01.361626 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286ca418-61ec-4645-992b-54c426a84eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:01.364302 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286ca418-61ec-4645-992b-54c426a84eb2 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:01.364302 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286ca418-61ec-4645-992b-54c426a84eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:01.364302 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286ca418-61ec-4645-992b-54c426a84eb2 None admin] PATH_INFO: `/v3/projects/befb09928b604b3e89c10a3f78d3aede` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:01.365035 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286ca418-61ec-4645-992b-54c426a84eb2 None admin] RBAC: Authorizing `identity:get_project(project_id=befb09928b604b3e89c10a3f78d3aede)` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:01.366520 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286ca418-61ec-4645-992b-54c426a84eb2 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:01.368467 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 216/425] 10.222.0.62 () {56 vars in 1186 bytes} [Fri May 27 08:27:01 2022] GET /identity/v3/projects/befb09928b604b3e89c10a3f78d3aede => generated 298 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:27:01.374998 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286ca418-61ec-4645-992b-54c426a84eb2 None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:01.419169 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:01.439194 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49b0481-8690-4802-9aaa-08902c5d380b None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:01.455907 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:01.498280 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e73597-b875-4bd4-a8bf-6b53eace32bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:01.499038 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e73597-b875-4bd4-a8bf-6b53eace32bf None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:01.499392 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e73597-b875-4bd4-a8bf-6b53eace32bf None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:01.499739 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e73597-b875-4bd4-a8bf-6b53eace32bf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:01.544256 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286ca418-61ec-4645-992b-54c426a84eb2 None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:01.587987 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694f3731-d8f0-4ec9-b0a6-1d9f0788a22a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:01.589441 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694f3731-d8f0-4ec9-b0a6-1d9f0788a22a None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:01.590778 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694f3731-d8f0-4ec9-b0a6-1d9f0788a22a None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:01.591428 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694f3731-d8f0-4ec9-b0a6-1d9f0788a22a None admin] PATH_INFO: `/v3/groups/1edbdb0d4e6e40bba8a9c900d741bc93` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:01.594617 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694f3731-d8f0-4ec9-b0a6-1d9f0788a22a None admin] RBAC: Authorizing `identity:get_group(group_id=1edbdb0d4e6e40bba8a9c900d741bc93)` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:01.596571 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694f3731-d8f0-4ec9-b0a6-1d9f0788a22a None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:01.599780 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 217/426] 10.222.0.62 () {56 vars in 1180 bytes} [Fri May 27 08:27:01 2022] GET /identity/v3/groups/1edbdb0d4e6e40bba8a9c900d741bc93 => generated 226 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:27:01.607449 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694f3731-d8f0-4ec9-b0a6-1d9f0788a22a None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:01.657571 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e73597-b875-4bd4-a8bf-6b53eace32bf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:01.659719 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e73597-b875-4bd4-a8bf-6b53eace32bf None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:01.757735 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694f3731-d8f0-4ec9-b0a6-1d9f0788a22a None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:01.765905 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:01.796159 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba774f67-d75e-4b25-8c41-f4267aaf2d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:01.796888 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba774f67-d75e-4b25-8c41-f4267aaf2d58 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:01.797203 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba774f67-d75e-4b25-8c41-f4267aaf2d58 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:01.797504 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba774f67-d75e-4b25-8c41-f4267aaf2d58 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:01.798571 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba774f67-d75e-4b25-8c41-f4267aaf2d58 None admin] RBAC: Adding query filter params (group.id=1edbdb0d4e6e40bba8a9c900d741bc93, role.id=c980c64bb84b418daa012ae45a054b37, scope.project.id=befb09928b604b3e89c10a3f78d3aede) {{(pid=87172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:27:01.799564 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba774f67-d75e-4b25-8c41-f4267aaf2d58 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:01.801370 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba774f67-d75e-4b25-8c41-f4267aaf2d58 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:01.808550 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 218/427] 10.222.0.62 () {56 vars in 1376 bytes} [Fri May 27 08:27:01 2022] GET /identity/v3/role_assignments?group.id=1edbdb0d4e6e40bba8a9c900d741bc93&scope.project.id=befb09928b604b3e89c10a3f78d3aede&role.id=c980c64bb84b418daa012ae45a054b37 => generated 611 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:27:01.841509 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:01.874372 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 210/428] 10.222.0.62 () {58 vars in 1282 bytes} [Fri May 27 08:27:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 598 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 08:27:01.883630 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba774f67-d75e-4b25-8c41-f4267aaf2d58 None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:02.039175 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba774f67-d75e-4b25-8c41-f4267aaf2d58 None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:02.094980 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5d2f70-2ff9-4c07-9dce-4741ac99e1fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:02.096281 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5d2f70-2ff9-4c07-9dce-4741ac99e1fb None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:02.096802 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5d2f70-2ff9-4c07-9dce-4741ac99e1fb None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:02.097484 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5d2f70-2ff9-4c07-9dce-4741ac99e1fb None admin] PATH_INFO: `/v3/projects/befb09928b604b3e89c10a3f78d3aede` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:02.098945 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5d2f70-2ff9-4c07-9dce-4741ac99e1fb None admin] RBAC: Authorizing `identity:get_project(project_id=befb09928b604b3e89c10a3f78d3aede)` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:02.100626 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5d2f70-2ff9-4c07-9dce-4741ac99e1fb None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:02.102585 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 219/429] 10.222.0.62 () {56 vars in 1186 bytes} [Fri May 27 08:27:01 2022] GET /identity/v3/projects/befb09928b604b3e89c10a3f78d3aede => generated 298 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:27:02.108884 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e73597-b875-4bd4-a8bf-6b53eace32bf None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:02.248581 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e73597-b875-4bd4-a8bf-6b53eace32bf None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:02.296326 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280dc4f6-3b16-4e44-996d-4f82a697b658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:02.297139 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280dc4f6-3b16-4e44-996d-4f82a697b658 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:02.297421 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280dc4f6-3b16-4e44-996d-4f82a697b658 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:02.297697 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280dc4f6-3b16-4e44-996d-4f82a697b658 None admin] PATH_INFO: `/v3/groups/1edbdb0d4e6e40bba8a9c900d741bc93` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:02.298885 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280dc4f6-3b16-4e44-996d-4f82a697b658 None admin] RBAC: Authorizing `identity:get_group(group_id=1edbdb0d4e6e40bba8a9c900d741bc93)` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:02.301066 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280dc4f6-3b16-4e44-996d-4f82a697b658 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:02.307268 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 211/430] 10.222.0.62 () {56 vars in 1180 bytes} [Fri May 27 08:27:02 2022] GET /identity/v3/groups/1edbdb0d4e6e40bba8a9c900d741bc93 => generated 226 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:27:02.310843 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5d2f70-2ff9-4c07-9dce-4741ac99e1fb None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:02.360367 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:02.445248 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5d2f70-2ff9-4c07-9dce-4741ac99e1fb None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:02.486411 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4e2a57-8ebd-4e07-bf26-7bdefe9b3ec8 None None] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:02.486980 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4e2a57-8ebd-4e07-bf26-7bdefe9b3ec8 None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:02.486980 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4e2a57-8ebd-4e07-bf26-7bdefe9b3ec8 None None] PATH_INFO: `/` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:02.488813 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 212/431] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:27:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 08:27:02.490878 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2385c3-57bb-4068-b41d-d238662c7251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:02.491552 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2385c3-57bb-4068-b41d-d238662c7251 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:02.491835 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2385c3-57bb-4068-b41d-d238662c7251 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:02.492118 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2385c3-57bb-4068-b41d-d238662c7251 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:02.493192 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2385c3-57bb-4068-b41d-d238662c7251 None admin] RBAC: Adding query filter params (group.id=1edbdb0d4e6e40bba8a9c900d741bc93, role.id=9ff71fb5e7b7407d8d243eaa7da0a125, scope.project.id=befb09928b604b3e89c10a3f78d3aede) {{(pid=87172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:27:02.493511 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2385c3-57bb-4068-b41d-d238662c7251 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:02.494791 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b52bf6-eaed-4f74-8982-3e79a98ef4ab None None] REQUEST_METHOD: `POST` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:02.495060 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2385c3-57bb-4068-b41d-d238662c7251 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:02.495178 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b52bf6-eaed-4f74-8982-3e79a98ef4ab None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:02.495355 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b52bf6-eaed-4f74-8982-3e79a98ef4ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:02.508263 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 220/432] 10.222.0.62 () {56 vars in 1376 bytes} [Fri May 27 08:27:02 2022] GET /identity/v3/role_assignments?group.id=1edbdb0d4e6e40bba8a9c900d741bc93&scope.project.id=befb09928b604b3e89c10a3f78d3aede&role.id=9ff71fb5e7b7407d8d243eaa7da0a125 => generated 611 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:27:02.523168 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.auth.core [None req-84b52bf6-eaed-4f74-8982-3e79a98ef4ab None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:27:02.524477 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.fernet_utils [None req-84b52bf6-eaed-4f74-8982-3e79a98ef4ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:27:02.595242 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:02.622857 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 213/433] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:27:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 08:27:02.651066 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2385c3-57bb-4068-b41d-d238662c7251 None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:02.803746 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2385c3-57bb-4068-b41d-d238662c7251 None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:02.805686 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:02.852147 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbadf53-ff1d-4389-8e07-9b819c3cd31c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:02.853472 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbadf53-ff1d-4389-8e07-9b819c3cd31c None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:02.853976 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbadf53-ff1d-4389-8e07-9b819c3cd31c None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:02.854459 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbadf53-ff1d-4389-8e07-9b819c3cd31c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:02.868107 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbadf53-ff1d-4389-8e07-9b819c3cd31c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 08:27:02.876429 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application [None req-fdbadf53-ff1d-4389-8e07-9b819c3cd31c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 08:27:02.876429 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:27:02.876429 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:27:02.876429 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:27:02.876429 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:27:02.876429 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:27:02.876429 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:27:02.876429 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:27:02.876429 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:27:02.876429 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:27:02.876429 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:27:02.876429 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:27:02.876429 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 08:27:02.876429 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 08:27:02.876429 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 08:27:02.876429 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 08:27:02.878034 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 08:27:02.878034 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 08:27:02.878034 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 08:27:02.878034 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 08:27:02.878034 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:27:02.878034 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:27:02.878034 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:27:02.878034 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:27:02.878034 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:27:02.878034 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:27:02.878034 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:27:02.878034 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application with Lock( May 27 08:27:02.878034 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:27:02.878034 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._enter() May 27 08:27:02.878034 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:27:02.878034 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:27:02.878831 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:27:02.878831 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.creator() May 27 08:27:02.878831 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:27:02.878831 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application created_value = creator( May 27 08:27:02.878831 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 08:27:02.878831 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 08:27:02.878831 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 08:27:02.878831 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 08:27:02.878831 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 08:27:02.878831 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 08:27:02.878831 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 08:27:02.878831 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application May 27 08:27:02.881275 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 221/434] 10.222.0.62 () {56 vars in 1096 bytes} [Fri May 27 08:27:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 08:27:02.887235 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b52bf6-eaed-4f74-8982-3e79a98ef4ab None None] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:02.963312 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804b468c-4f96-4fb8-83e8-a4b0ec37e8d6 None None] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:02.963628 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804b468c-4f96-4fb8-83e8-a4b0ec37e8d6 None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:02.963876 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804b468c-4f96-4fb8-83e8-a4b0ec37e8d6 None None] PATH_INFO: `/` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:02.965579 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 222/435] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:27:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:27:02.973177 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3495e8-7237-4b0c-ba3f-78b05797bb1a None None] REQUEST_METHOD: `POST` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:02.973484 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3495e8-7237-4b0c-ba3f-78b05797bb1a None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:02.973735 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3495e8-7237-4b0c-ba3f-78b05797bb1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:02.997012 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.auth.core [None req-0d3495e8-7237-4b0c-ba3f-78b05797bb1a None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:27:02.998220 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.fernet_utils [None req-0d3495e8-7237-4b0c-ba3f-78b05797bb1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:27:03.010312 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b52bf6-eaed-4f74-8982-3e79a98ef4ab None None] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:03.062780 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c249c45-2843-4271-ab61-ebaaaf5cc67b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:03.063471 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c249c45-2843-4271-ab61-ebaaaf5cc67b None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:03.063751 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c249c45-2843-4271-ab61-ebaaaf5cc67b None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:03.064420 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c249c45-2843-4271-ab61-ebaaaf5cc67b None admin] PATH_INFO: `/v3/roles` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:03.065322 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c249c45-2843-4271-ab61-ebaaaf5cc67b None admin] RBAC: Adding query filter params (name=admin) {{(pid=87173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:27:03.065620 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c249c45-2843-4271-ab61-ebaaaf5cc67b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:03.067024 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c249c45-2843-4271-ab61-ebaaaf5cc67b None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:03.077294 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 214/436] 10.222.0.62 () {56 vars in 1099 bytes} [Fri May 27 08:27:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 08:27:03.078608 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33a99db-24eb-435e-80e5-49e89c1f7939 None None] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:03.078896 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33a99db-24eb-435e-80e5-49e89c1f7939 None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:03.079168 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33a99db-24eb-435e-80e5-49e89c1f7939 None None] PATH_INFO: `/` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:03.081394 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 215/437] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:27:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:27:03.088725 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33a99db-24eb-435e-80e5-49e89c1f7939 None None] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:03.091843 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 223/438] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:27:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 08:27:03.093570 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d33116-8633-46c4-81b6-6c2567d4b9dc None None] REQUEST_METHOD: `POST` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:03.094089 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d33116-8633-46c4-81b6-6c2567d4b9dc None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:03.094566 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d33116-8633-46c4-81b6-6c2567d4b9dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:03.119976 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.auth.core [None req-15d33116-8633-46c4-81b6-6c2567d4b9dc None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:27:03.121217 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.fernet_utils [None req-15d33116-8633-46c4-81b6-6c2567d4b9dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:27:03.148907 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:03.194221 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 224/439] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:27:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 08:27:03.195086 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d33116-8633-46c4-81b6-6c2567d4b9dc None None] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:03.220961 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:03.228860 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33a99db-24eb-435e-80e5-49e89c1f7939 None None] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:03.268143 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075f6e25-8d2a-4b9c-a4d7-7184fb54fae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:03.269023 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075f6e25-8d2a-4b9c-a4d7-7184fb54fae5 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:03.269319 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075f6e25-8d2a-4b9c-a4d7-7184fb54fae5 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:03.269603 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075f6e25-8d2a-4b9c-a4d7-7184fb54fae5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:03.313074 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d33116-8633-46c4-81b6-6c2567d4b9dc None None] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:03.342586 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075f6e25-8d2a-4b9c-a4d7-7184fb54fae5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:03.344063 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075f6e25-8d2a-4b9c-a4d7-7184fb54fae5 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:03.356400 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b667551-63de-466f-96f2-92e7bce689f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:03.357252 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b667551-63de-466f-96f2-92e7bce689f9 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:03.357536 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b667551-63de-466f-96f2-92e7bce689f9 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:03.357810 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b667551-63de-466f-96f2-92e7bce689f9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:03.370381 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b667551-63de-466f-96f2-92e7bce689f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 08:27:03.379501 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application [None req-0b667551-63de-466f-96f2-92e7bce689f9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 08:27:03.379501 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:27:03.379501 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:27:03.379501 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:27:03.379501 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:27:03.379501 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:27:03.379501 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:27:03.379501 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:27:03.379501 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:27:03.379501 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:27:03.379501 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:27:03.379501 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:27:03.379501 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 08:27:03.379501 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 08:27:03.379501 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 08:27:03.379501 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 08:27:03.380788 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 08:27:03.380788 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 08:27:03.380788 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 08:27:03.380788 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 08:27:03.380788 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:27:03.380788 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:27:03.380788 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:27:03.380788 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:27:03.380788 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:27:03.380788 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:27:03.380788 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:27:03.380788 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application with Lock( May 27 08:27:03.380788 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:27:03.380788 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._enter() May 27 08:27:03.380788 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:27:03.380788 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:27:03.381653 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:27:03.381653 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.creator() May 27 08:27:03.381653 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:27:03.381653 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application created_value = creator( May 27 08:27:03.381653 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 08:27:03.381653 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 08:27:03.381653 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 08:27:03.381653 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 08:27:03.381653 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 08:27:03.381653 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 08:27:03.381653 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 27 08:27:03.381653 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application May 27 08:27:03.381653 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 225/440] 10.222.0.62 () {56 vars in 1114 bytes} [Fri May 27 08:27:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 08:27:03.381653 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b667551-63de-466f-96f2-92e7bce689f9 None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:03.392947 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:03.449387 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 216/441] 10.222.0.62 () {58 vars in 1282 bytes} [Fri May 27 08:27:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 08:27:03.450229 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075f6e25-8d2a-4b9c-a4d7-7184fb54fae5 None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:03.467200 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:03.485732 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b667551-63de-466f-96f2-92e7bce689f9 None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:03.521448 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6e2fe9-a5e3-4272-bb3b-5f2a157ccdde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:03.522242 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6e2fe9-a5e3-4272-bb3b-5f2a157ccdde None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:03.522521 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6e2fe9-a5e3-4272-bb3b-5f2a157ccdde None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:03.522795 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6e2fe9-a5e3-4272-bb3b-5f2a157ccdde None admin] PATH_INFO: `/v3/roles/member` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:03.532875 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6e2fe9-a5e3-4272-bb3b-5f2a157ccdde None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 08:27:03.542243 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application [None req-dc6e2fe9-a5e3-4272-bb3b-5f2a157ccdde None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 27 08:27:03.542243 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:27:03.542243 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:27:03.542243 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:27:03.542243 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:27:03.542243 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:27:03.542243 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:27:03.542243 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:27:03.542243 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:27:03.542243 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:27:03.542243 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:27:03.542243 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:27:03.542243 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 08:27:03.542243 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 08:27:03.542243 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 08:27:03.542243 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 08:27:03.543554 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 08:27:03.543554 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 08:27:03.543554 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 08:27:03.543554 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 08:27:03.543554 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:27:03.543554 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:27:03.543554 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:27:03.543554 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:27:03.543554 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:27:03.543554 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:27:03.543554 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:27:03.543554 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application with Lock( May 27 08:27:03.543554 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:27:03.543554 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._enter() May 27 08:27:03.543554 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:27:03.543554 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:27:03.544673 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:27:03.544673 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.creator() May 27 08:27:03.544673 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:27:03.544673 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application created_value = creator( May 27 08:27:03.544673 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 08:27:03.544673 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 08:27:03.544673 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 08:27:03.544673 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 08:27:03.544673 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 08:27:03.544673 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 08:27:03.544673 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 27 08:27:03.544673 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application May 27 08:27:03.544673 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 226/442] 10.222.0.62 () {56 vars in 1099 bytes} [Fri May 27 08:27:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 08:27:03.544673 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6e2fe9-a5e3-4272-bb3b-5f2a157ccdde None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:03.560881 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075f6e25-8d2a-4b9c-a4d7-7184fb54fae5 None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:03.597777 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d643afd4-3517-42e2-921b-6867c119ad11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:03.598821 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d643afd4-3517-42e2-921b-6867c119ad11 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:03.599107 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d643afd4-3517-42e2-921b-6867c119ad11 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:03.599376 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d643afd4-3517-42e2-921b-6867c119ad11 None admin] PATH_INFO: `/v3/roles` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:03.600127 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d643afd4-3517-42e2-921b-6867c119ad11 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:27:03.600498 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d643afd4-3517-42e2-921b-6867c119ad11 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:03.601836 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d643afd4-3517-42e2-921b-6867c119ad11 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:03.610320 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 217/443] 10.222.0.62 () {56 vars in 1111 bytes} [Fri May 27 08:27:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:27:03.611152 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d643afd4-3517-42e2-921b-6867c119ad11 None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:03.621370 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:03.660061 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6e2fe9-a5e3-4272-bb3b-5f2a157ccdde None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:03.696822 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae54ab33-c65c-4c4b-a250-9493681964ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:03.697682 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae54ab33-c65c-4c4b-a250-9493681964ea None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:03.697968 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae54ab33-c65c-4c4b-a250-9493681964ea None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:03.698254 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae54ab33-c65c-4c4b-a250-9493681964ea None admin] PATH_INFO: `/v3/projects/db9f476e682c4ed795ebf3f955e975c9` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:03.699461 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae54ab33-c65c-4c4b-a250-9493681964ea None admin] RBAC: Authorizing `identity:get_project(project_id=db9f476e682c4ed795ebf3f955e975c9)` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:03.700981 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae54ab33-c65c-4c4b-a250-9493681964ea None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:03.702690 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 227/444] 10.222.0.62 () {56 vars in 1186 bytes} [Fri May 27 08:27:03 2022] GET /identity/v3/projects/db9f476e682c4ed795ebf3f955e975c9 => generated 344 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:27:03.703465 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae54ab33-c65c-4c4b-a250-9493681964ea None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:03.724209 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d643afd4-3517-42e2-921b-6867c119ad11 None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:03.724913 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:03.767132 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbf3ad5-8274-4aa7-8925-73d95025ec11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:03.768164 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbf3ad5-8274-4aa7-8925-73d95025ec11 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:03.768479 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbf3ad5-8274-4aa7-8925-73d95025ec11 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:03.768940 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbf3ad5-8274-4aa7-8925-73d95025ec11 None admin] PATH_INFO: `/v3/roles` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:03.769691 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbf3ad5-8274-4aa7-8925-73d95025ec11 None admin] RBAC: Adding query filter params (name=member) {{(pid=87173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:27:03.770090 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbf3ad5-8274-4aa7-8925-73d95025ec11 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:03.771516 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbf3ad5-8274-4aa7-8925-73d95025ec11 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:03.780169 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 218/445] 10.222.0.62 () {56 vars in 1101 bytes} [Fri May 27 08:27:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:27:03.781016 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbf3ad5-8274-4aa7-8925-73d95025ec11 None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:03.831028 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae54ab33-c65c-4c4b-a250-9493681964ea None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:03.849101 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:03.866685 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193807ee-03e6-4077-8753-57ca121bf3f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:03.867349 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193807ee-03e6-4077-8753-57ca121bf3f8 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:03.867643 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193807ee-03e6-4077-8753-57ca121bf3f8 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:03.867920 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193807ee-03e6-4077-8753-57ca121bf3f8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:03.891046 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbf3ad5-8274-4aa7-8925-73d95025ec11 None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:03.927336 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e695af-867d-428d-b759-754822f91c8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:03.928188 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e695af-867d-428d-b759-754822f91c8c None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:03.928480 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e695af-867d-428d-b759-754822f91c8c None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:03.928790 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e695af-867d-428d-b759-754822f91c8c None admin] PATH_INFO: `/v3/groups/8e5b8dac147e4726a6ef0eaf19d26824` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:03.929990 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e695af-867d-428d-b759-754822f91c8c None admin] RBAC: Authorizing `identity:get_group(group_id=8e5b8dac147e4726a6ef0eaf19d26824)` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:03.931461 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e695af-867d-428d-b759-754822f91c8c None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:03.933159 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 219/446] 10.222.0.62 () {56 vars in 1180 bytes} [Fri May 27 08:27:03 2022] GET /identity/v3/groups/8e5b8dac147e4726a6ef0eaf19d26824 => generated 229 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:27:03.933929 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e695af-867d-428d-b759-754822f91c8c None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:03.938683 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193807ee-03e6-4077-8753-57ca121bf3f8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:03.940200 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193807ee-03e6-4077-8753-57ca121bf3f8 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:03.951583 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:04.042931 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e695af-867d-428d-b759-754822f91c8c None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:04.048815 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 228/447] 10.222.0.62 () {58 vars in 1282 bytes} [Fri May 27 08:27:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 08:27:04.050172 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193807ee-03e6-4077-8753-57ca121bf3f8 None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:04.083217 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e533a39e-b369-4cb5-80b4-9fbaf5e416d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:04.083873 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e533a39e-b369-4cb5-80b4-9fbaf5e416d1 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:04.084161 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e533a39e-b369-4cb5-80b4-9fbaf5e416d1 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:04.084444 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e533a39e-b369-4cb5-80b4-9fbaf5e416d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:04.088047 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:04.162120 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e533a39e-b369-4cb5-80b4-9fbaf5e416d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:04.162962 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193807ee-03e6-4077-8753-57ca121bf3f8 None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:04.163526 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e533a39e-b369-4cb5-80b4-9fbaf5e416d1 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:04.176676 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:04.202883 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e311b0e-29fa-47aa-b84d-2caef3d674c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:04.203539 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e311b0e-29fa-47aa-b84d-2caef3d674c3 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:04.203821 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e311b0e-29fa-47aa-b84d-2caef3d674c3 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:04.204094 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e311b0e-29fa-47aa-b84d-2caef3d674c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:04.204963 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e311b0e-29fa-47aa-b84d-2caef3d674c3 None admin] RBAC: Adding query filter params (group.id=8e5b8dac147e4726a6ef0eaf19d26824, role.id=5e6f243a7201412c965e7c70249d4dc0, scope.project.id=db9f476e682c4ed795ebf3f955e975c9) {{(pid=87172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:27:04.205322 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e311b0e-29fa-47aa-b84d-2caef3d674c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:04.206784 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e311b0e-29fa-47aa-b84d-2caef3d674c3 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:04.224627 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 229/448] 10.222.0.62 () {56 vars in 1376 bytes} [Fri May 27 08:27:04 2022] GET /identity/v3/role_assignments?group.id=8e5b8dac147e4726a6ef0eaf19d26824&scope.project.id=db9f476e682c4ed795ebf3f955e975c9&role.id=5e6f243a7201412c965e7c70249d4dc0 => generated 611 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:27:04.224627 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e311b0e-29fa-47aa-b84d-2caef3d674c3 None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:04.279994 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 220/449] 10.222.0.62 () {58 vars in 1282 bytes} [Fri May 27 08:27:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 08:27:04.287107 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e533a39e-b369-4cb5-80b4-9fbaf5e416d1 None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:04.327645 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:04.361975 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e311b0e-29fa-47aa-b84d-2caef3d674c3 None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:04.415996 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320df712-af8e-4c0d-8361-6085b3115fa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:04.416814 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320df712-af8e-4c0d-8361-6085b3115fa5 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:04.417106 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320df712-af8e-4c0d-8361-6085b3115fa5 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:04.417390 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320df712-af8e-4c0d-8361-6085b3115fa5 None admin] PATH_INFO: `/v3/projects/7086655a913e49b899fae73f13ec6c42` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:04.418635 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320df712-af8e-4c0d-8361-6085b3115fa5 None admin] RBAC: Authorizing `identity:get_project(project_id=7086655a913e49b899fae73f13ec6c42)` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:04.418862 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e533a39e-b369-4cb5-80b4-9fbaf5e416d1 None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:04.420092 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320df712-af8e-4c0d-8361-6085b3115fa5 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:04.421869 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 230/450] 10.222.0.62 () {56 vars in 1186 bytes} [Fri May 27 08:27:04 2022] GET /identity/v3/projects/7086655a913e49b899fae73f13ec6c42 => generated 302 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:27:04.428450 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320df712-af8e-4c0d-8361-6085b3115fa5 None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:04.463797 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd5bfdb-fc55-4427-a41a-843ccd2f66b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:04.464715 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd5bfdb-fc55-4427-a41a-843ccd2f66b7 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:04.465008 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd5bfdb-fc55-4427-a41a-843ccd2f66b7 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:04.465291 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd5bfdb-fc55-4427-a41a-843ccd2f66b7 None admin] PATH_INFO: `/v3/projects/7086655a913e49b899fae73f13ec6c42` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:04.473121 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd5bfdb-fc55-4427-a41a-843ccd2f66b7 None admin] RBAC: Authorizing `identity:get_project(project_id=7086655a913e49b899fae73f13ec6c42)` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:04.473121 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd5bfdb-fc55-4427-a41a-843ccd2f66b7 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:04.473121 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 221/451] 10.222.0.62 () {56 vars in 1186 bytes} [Fri May 27 08:27:04 2022] GET /identity/v3/projects/7086655a913e49b899fae73f13ec6c42 => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 08:27:04.478681 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd5bfdb-fc55-4427-a41a-843ccd2f66b7 None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:04.488627 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:04.551450 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320df712-af8e-4c0d-8361-6085b3115fa5 None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:04.592404 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2e4201-dc3c-43e6-ad16-a31ba2208f7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:04.593330 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2e4201-dc3c-43e6-ad16-a31ba2208f7b None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:04.593621 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2e4201-dc3c-43e6-ad16-a31ba2208f7b None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:04.593908 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2e4201-dc3c-43e6-ad16-a31ba2208f7b None admin] PATH_INFO: `/v3/groups/1edbdb0d4e6e40bba8a9c900d741bc93` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:04.595261 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2e4201-dc3c-43e6-ad16-a31ba2208f7b None admin] RBAC: Authorizing `identity:get_group(group_id=1edbdb0d4e6e40bba8a9c900d741bc93)` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:04.596913 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2e4201-dc3c-43e6-ad16-a31ba2208f7b None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:04.598699 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 231/452] 10.222.0.62 () {56 vars in 1180 bytes} [Fri May 27 08:27:04 2022] GET /identity/v3/groups/1edbdb0d4e6e40bba8a9c900d741bc93 => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 08:27:04.604755 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2e4201-dc3c-43e6-ad16-a31ba2208f7b None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:04.613240 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd5bfdb-fc55-4427-a41a-843ccd2f66b7 None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:04.616004 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:04.659140 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937fb264-3e43-4314-a78f-e29a064d00ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:04.660129 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937fb264-3e43-4314-a78f-e29a064d00ad None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:04.660415 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937fb264-3e43-4314-a78f-e29a064d00ad None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:04.660731 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937fb264-3e43-4314-a78f-e29a064d00ad None admin] PATH_INFO: `/v3/groups/1edbdb0d4e6e40bba8a9c900d741bc93` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:04.662297 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937fb264-3e43-4314-a78f-e29a064d00ad None admin] RBAC: Authorizing `identity:get_group(group_id=1edbdb0d4e6e40bba8a9c900d741bc93)` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:04.663804 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937fb264-3e43-4314-a78f-e29a064d00ad None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:04.665592 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 222/453] 10.222.0.62 () {56 vars in 1180 bytes} [Fri May 27 08:27:04 2022] GET /identity/v3/groups/1edbdb0d4e6e40bba8a9c900d741bc93 => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 08:27:04.671669 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937fb264-3e43-4314-a78f-e29a064d00ad None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:04.733922 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2e4201-dc3c-43e6-ad16-a31ba2208f7b None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:04.746938 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:04.772279 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0751c781-57f9-4197-b22e-59c34afb1710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:04.773019 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0751c781-57f9-4197-b22e-59c34afb1710 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:04.773350 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0751c781-57f9-4197-b22e-59c34afb1710 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:04.773518 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0751c781-57f9-4197-b22e-59c34afb1710 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:04.774425 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0751c781-57f9-4197-b22e-59c34afb1710 None admin] RBAC: Adding query filter params (group.id=1edbdb0d4e6e40bba8a9c900d741bc93, role.id=9ff71fb5e7b7407d8d243eaa7da0a125, scope.project.id=7086655a913e49b899fae73f13ec6c42) {{(pid=87172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:27:04.774688 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0751c781-57f9-4197-b22e-59c34afb1710 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:04.776087 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0751c781-57f9-4197-b22e-59c34afb1710 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:04.781194 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937fb264-3e43-4314-a78f-e29a064d00ad None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:04.782420 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 232/454] 10.222.0.62 () {56 vars in 1376 bytes} [Fri May 27 08:27:04 2022] GET /identity/v3/role_assignments?group.id=1edbdb0d4e6e40bba8a9c900d741bc93&scope.project.id=7086655a913e49b899fae73f13ec6c42&role.id=9ff71fb5e7b7407d8d243eaa7da0a125 => generated 611 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 08:27:04.825061 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db9c464-6082-4190-bc77-83999929a07e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:04.826102 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db9c464-6082-4190-bc77-83999929a07e None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:04.826497 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db9c464-6082-4190-bc77-83999929a07e None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:04.826785 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db9c464-6082-4190-bc77-83999929a07e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:04.827747 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db9c464-6082-4190-bc77-83999929a07e None admin] RBAC: Adding query filter params (group.id=1edbdb0d4e6e40bba8a9c900d741bc93, role.id=c980c64bb84b418daa012ae45a054b37, scope.project.id=7086655a913e49b899fae73f13ec6c42) {{(pid=87173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:27:04.828066 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db9c464-6082-4190-bc77-83999929a07e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:04.830753 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db9c464-6082-4190-bc77-83999929a07e None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:04.841184 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 223/455] 10.222.0.62 () {56 vars in 1376 bytes} [Fri May 27 08:27:04 2022] GET /identity/v3/role_assignments?group.id=1edbdb0d4e6e40bba8a9c900d741bc93&scope.project.id=7086655a913e49b899fae73f13ec6c42&role.id=c980c64bb84b418daa012ae45a054b37 => generated 611 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 08:27:07.836700 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab12b4bd-c3a1-41f8-822d-9e472506e2aa None None] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:07.837255 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab12b4bd-c3a1-41f8-822d-9e472506e2aa None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:07.837334 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab12b4bd-c3a1-41f8-822d-9e472506e2aa None None] PATH_INFO: `/` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:07.838993 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 233/456] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:27:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:27:07.844402 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c15ad7-8328-41de-8faf-6c3a06acbf08 None None] REQUEST_METHOD: `POST` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:07.845363 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c15ad7-8328-41de-8faf-6c3a06acbf08 None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:07.846003 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c15ad7-8328-41de-8faf-6c3a06acbf08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:07.865633 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.auth.core [None req-28c15ad7-8328-41de-8faf-6c3a06acbf08 None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:27:07.867209 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.fernet_utils [None req-28c15ad7-8328-41de-8faf-6c3a06acbf08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:27:07.900341 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:07.949909 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 224/457] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:27:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 08:27:07.978028 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab12b4bd-c3a1-41f8-822d-9e472506e2aa None None] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:08.090357 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab12b4bd-c3a1-41f8-822d-9e472506e2aa None None] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:08.127951 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e005c3ab-4f25-4487-80d5-8d29205d6cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:08.129148 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e005c3ab-4f25-4487-80d5-8d29205d6cf7 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:08.129656 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e005c3ab-4f25-4487-80d5-8d29205d6cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:08.130153 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e005c3ab-4f25-4487-80d5-8d29205d6cf7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:08.131716 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df9a653-18de-46df-8ae9-0662ac7adf50 None None] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:08.132010 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df9a653-18de-46df-8ae9-0662ac7adf50 None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:08.132286 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df9a653-18de-46df-8ae9-0662ac7adf50 None None] PATH_INFO: `/` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:08.134143 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 225/458] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:27:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 08:27:08.139238 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9210f876-aad6-46ec-a015-c211cc14fdb3 None None] REQUEST_METHOD: `POST` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:08.139526 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9210f876-aad6-46ec-a015-c211cc14fdb3 None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:08.139808 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9210f876-aad6-46ec-a015-c211cc14fdb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:08.145387 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e005c3ab-4f25-4487-80d5-8d29205d6cf7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:08.147069 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e005c3ab-4f25-4487-80d5-8d29205d6cf7 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:08.157566 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.auth.core [None req-9210f876-aad6-46ec-a015-c211cc14fdb3 None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:27:08.159261 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.fernet_utils [None req-9210f876-aad6-46ec-a015-c211cc14fdb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:27:08.165750 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application [None req-e005c3ab-4f25-4487-80d5-8d29205d6cf7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 08:27:08.165750 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:27:08.165750 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:27:08.165750 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:27:08.165750 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:27:08.165750 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:27:08.165750 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:27:08.165750 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:27:08.165750 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:27:08.165750 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:27:08.165750 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:27:08.165750 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:27:08.165750 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 08:27:08.165750 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 08:27:08.165750 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 08:27:08.166632 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 08:27:08.166632 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:27:08.166632 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:27:08.166632 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:27:08.166632 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:27:08.166632 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:27:08.166632 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:27:08.166632 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:27:08.166632 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application with Lock( May 27 08:27:08.166632 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:27:08.166632 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._enter() May 27 08:27:08.166632 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:27:08.166632 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:27:08.166632 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:27:08.166632 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.creator() May 27 08:27:08.166632 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:27:08.166632 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application created_value = creator( May 27 08:27:08.168625 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 08:27:08.168625 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 08:27:08.168625 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 08:27:08.168625 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application May 27 08:27:08.168625 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 234/459] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 08:27:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 08:27:08.168625 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8905737f-bc05-4f25-adf6-6dd8e6e2f82d None None] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:08.168971 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8905737f-bc05-4f25-adf6-6dd8e6e2f82d None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:08.169279 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8905737f-bc05-4f25-adf6-6dd8e6e2f82d None None] PATH_INFO: `/` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:08.172642 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 235/460] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:27:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:27:08.172642 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8905737f-bc05-4f25-adf6-6dd8e6e2f82d None None] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:08.211151 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:08.248638 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 226/461] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:27:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 08:27:08.248638 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1108c86-35dc-4887-b91c-f3d50159ce26 None None] REQUEST_METHOD: `POST` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:08.248638 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1108c86-35dc-4887-b91c-f3d50159ce26 None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:08.248638 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1108c86-35dc-4887-b91c-f3d50159ce26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:08.267175 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.auth.core [None req-f1108c86-35dc-4887-b91c-f3d50159ce26 None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:27:08.268761 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.fernet_utils [None req-f1108c86-35dc-4887-b91c-f3d50159ce26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:27:08.318763 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8905737f-bc05-4f25-adf6-6dd8e6e2f82d None None] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:08.349006 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 227/462] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:27:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 08:27:08.352823 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1108c86-35dc-4887-b91c-f3d50159ce26 None None] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:08.369081 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8ab7df-6ea7-40d0-a791-39430a3af124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:08.370172 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8ab7df-6ea7-40d0-a791-39430a3af124 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:08.370493 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8ab7df-6ea7-40d0-a791-39430a3af124 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:08.370987 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8ab7df-6ea7-40d0-a791-39430a3af124 None admin] PATH_INFO: `/v3/domains` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:08.372002 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8ab7df-6ea7-40d0-a791-39430a3af124 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:27:08.372652 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8ab7df-6ea7-40d0-a791-39430a3af124 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:08.374782 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8ab7df-6ea7-40d0-a791-39430a3af124 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:08.388673 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:08.391140 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 236/463] 10.222.0.62 () {56 vars in 1109 bytes} [Fri May 27 08:27:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 08:27:08.392158 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8ab7df-6ea7-40d0-a791-39430a3af124 None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:08.472756 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1108c86-35dc-4887-b91c-f3d50159ce26 None None] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:08.482894 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:08.498785 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8ab7df-6ea7-40d0-a791-39430a3af124 None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:08.508093 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9193c769-57bf-4f4d-ad81-dad465084806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:08.508923 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9193c769-57bf-4f4d-ad81-dad465084806 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:08.509206 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9193c769-57bf-4f4d-ad81-dad465084806 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:08.509487 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9193c769-57bf-4f4d-ad81-dad465084806 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:08.519539 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9193c769-57bf-4f4d-ad81-dad465084806 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:08.521044 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9193c769-57bf-4f4d-ad81-dad465084806 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:08.532794 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5e2d1b-a668-499c-8293-6f01ee03c6fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:08.533853 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5e2d1b-a668-499c-8293-6f01ee03c6fb None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:08.534152 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5e2d1b-a668-499c-8293-6f01ee03c6fb None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:08.534407 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5e2d1b-a668-499c-8293-6f01ee03c6fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:08.539799 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application [None req-9193c769-57bf-4f4d-ad81-dad465084806 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 08:27:08.539799 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:27:08.539799 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:27:08.539799 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:27:08.539799 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:27:08.539799 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:27:08.539799 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:27:08.539799 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:27:08.539799 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:27:08.539799 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:27:08.539799 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:27:08.539799 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:27:08.539799 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 08:27:08.539799 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 08:27:08.539799 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 08:27:08.540789 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 08:27:08.540789 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:27:08.540789 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:27:08.540789 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:27:08.540789 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:27:08.540789 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:27:08.540789 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:27:08.540789 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:27:08.540789 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application with Lock( May 27 08:27:08.540789 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:27:08.540789 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._enter() May 27 08:27:08.540789 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:27:08.540789 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:27:08.540789 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:27:08.540789 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.creator() May 27 08:27:08.540789 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:27:08.540789 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application created_value = creator( May 27 08:27:08.541775 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 08:27:08.541775 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 08:27:08.541775 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 08:27:08.541775 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application May 27 08:27:08.541775 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 228/464] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 08:27:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 08:27:08.542500 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9193c769-57bf-4f4d-ad81-dad465084806 None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:08.545584 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5e2d1b-a668-499c-8293-6f01ee03c6fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:08.547150 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5e2d1b-a668-499c-8293-6f01ee03c6fb None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:08.566554 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application [None req-0d5e2d1b-a668-499c-8293-6f01ee03c6fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 08:27:08.566554 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:27:08.566554 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:27:08.566554 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:27:08.566554 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:27:08.566554 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:27:08.566554 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:27:08.566554 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:27:08.566554 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:27:08.566554 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:27:08.566554 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:27:08.566554 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:27:08.566554 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 08:27:08.566554 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 08:27:08.566554 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 08:27:08.568311 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 08:27:08.568311 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:27:08.568311 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:27:08.568311 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:27:08.568311 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:27:08.568311 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:27:08.568311 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:27:08.568311 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:27:08.568311 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application with Lock( May 27 08:27:08.568311 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:27:08.568311 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._enter() May 27 08:27:08.568311 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:27:08.568311 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:27:08.568311 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:27:08.568311 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.creator() May 27 08:27:08.568311 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:27:08.568311 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application created_value = creator( May 27 08:27:08.569243 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 08:27:08.569243 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 08:27:08.569243 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 08:27:08.569243 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application May 27 08:27:08.569243 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 237/465] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 08:27:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 08:27:08.569243 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eba1ec7-e149-457b-a43b-c45a3d4ecf70 None None] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:08.569584 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eba1ec7-e149-457b-a43b-c45a3d4ecf70 None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:08.569584 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eba1ec7-e149-457b-a43b-c45a3d4ecf70 None None] PATH_INFO: `/` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:08.570953 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 238/466] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:27:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:27:08.571642 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eba1ec7-e149-457b-a43b-c45a3d4ecf70 None None] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:08.633065 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:08.660044 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9193c769-57bf-4f4d-ad81-dad465084806 None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:08.695399 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eba1ec7-e149-457b-a43b-c45a3d4ecf70 None None] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:08.703267 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e65bee-1f27-4249-b6cf-c43793b18396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:08.703942 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e65bee-1f27-4249-b6cf-c43793b18396 None admin] REQUEST_METHOD: `POST` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:08.704226 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e65bee-1f27-4249-b6cf-c43793b18396 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:08.704504 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e65bee-1f27-4249-b6cf-c43793b18396 None admin] PATH_INFO: `/v3/users` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:08.705463 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e65bee-1f27-4249-b6cf-c43793b18396 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:08.706997 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e65bee-1f27-4249-b6cf-c43793b18396 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:08.727944 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 229/467] 10.222.0.62 () {60 vars in 1132 bytes} [Fri May 27 08:27:08 2022] POST /identity/v3/users => generated 246 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 08:27:08.728737 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e65bee-1f27-4249-b6cf-c43793b18396 None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:08.732388 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5295db0-f922-47c7-88c5-53f3530e8451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:08.733093 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5295db0-f922-47c7-88c5-53f3530e8451 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:08.733380 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5295db0-f922-47c7-88c5-53f3530e8451 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:08.733654 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5295db0-f922-47c7-88c5-53f3530e8451 None admin] PATH_INFO: `/v3/domains` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:08.734407 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5295db0-f922-47c7-88c5-53f3530e8451 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:27:08.734714 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5295db0-f922-47c7-88c5-53f3530e8451 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:08.736669 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5295db0-f922-47c7-88c5-53f3530e8451 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:08.744777 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:08.753454 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 239/468] 10.222.0.62 () {56 vars in 1109 bytes} [Fri May 27 08:27:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:27:08.755165 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedbe6fe-c84b-4ecb-b412-69a3676eb6cc None None] REQUEST_METHOD: `POST` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:08.755460 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedbe6fe-c84b-4ecb-b412-69a3676eb6cc None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:08.755744 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedbe6fe-c84b-4ecb-b412-69a3676eb6cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:08.776583 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.auth.core [None req-dedbe6fe-c84b-4ecb-b412-69a3676eb6cc None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:27:08.777955 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.fernet_utils [None req-dedbe6fe-c84b-4ecb-b412-69a3676eb6cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:27:08.876648 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 240/469] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:27:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 08:27:08.876648 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedbe6fe-c84b-4ecb-b412-69a3676eb6cc None None] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:08.877708 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e65bee-1f27-4249-b6cf-c43793b18396 None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:08.934752 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2958fe8b-e7c6-40fd-8c38-1297a758c8b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:08.935460 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2958fe8b-e7c6-40fd-8c38-1297a758c8b1 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:08.935753 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2958fe8b-e7c6-40fd-8c38-1297a758c8b1 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:08.936030 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2958fe8b-e7c6-40fd-8c38-1297a758c8b1 None admin] PATH_INFO: `/v3/domains` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:08.936788 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2958fe8b-e7c6-40fd-8c38-1297a758c8b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:27:08.937101 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2958fe8b-e7c6-40fd-8c38-1297a758c8b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:08.938518 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2958fe8b-e7c6-40fd-8c38-1297a758c8b1 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:08.940620 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:08.956253 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 230/470] 10.222.0.62 () {56 vars in 1109 bytes} [Fri May 27 08:27:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:27:08.957150 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2958fe8b-e7c6-40fd-8c38-1297a758c8b1 None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:09.023404 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedbe6fe-c84b-4ecb-b412-69a3676eb6cc None None] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:09.055764 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:09.064661 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4b06f8-ed00-415c-bbcf-d60b393d0e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:09.065339 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4b06f8-ed00-415c-bbcf-d60b393d0e90 None admin] REQUEST_METHOD: `POST` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:09.065631 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4b06f8-ed00-415c-bbcf-d60b393d0e90 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:09.065913 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4b06f8-ed00-415c-bbcf-d60b393d0e90 None admin] PATH_INFO: `/v3/users` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:09.066636 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4b06f8-ed00-415c-bbcf-d60b393d0e90 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:09.068102 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4b06f8-ed00-415c-bbcf-d60b393d0e90 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:09.077191 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2958fe8b-e7c6-40fd-8c38-1297a758c8b1 None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:09.089629 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 241/471] 10.222.0.62 () {60 vars in 1132 bytes} [Fri May 27 08:27:08 2022] POST /identity/v3/users => generated 248 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 08:27:09.090659 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4b06f8-ed00-415c-bbcf-d60b393d0e90 None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:09.135238 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0951a2-79d6-4c1c-bc18-5e6df1beafb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:09.137502 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0951a2-79d6-4c1c-bc18-5e6df1beafb2 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:09.137965 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0951a2-79d6-4c1c-bc18-5e6df1beafb2 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:09.138387 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0951a2-79d6-4c1c-bc18-5e6df1beafb2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:09.156469 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0951a2-79d6-4c1c-bc18-5e6df1beafb2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:09.160095 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0951a2-79d6-4c1c-bc18-5e6df1beafb2 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:09.183831 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application [None req-0e0951a2-79d6-4c1c-bc18-5e6df1beafb2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 08:27:09.183831 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:27:09.183831 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:27:09.183831 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:27:09.183831 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:27:09.183831 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:27:09.183831 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:27:09.183831 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:27:09.183831 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:27:09.183831 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:27:09.183831 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:27:09.183831 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:27:09.183831 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 08:27:09.183831 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 08:27:09.183831 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 08:27:09.185614 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 08:27:09.185614 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:27:09.185614 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:27:09.185614 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:27:09.185614 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:27:09.185614 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:27:09.185614 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:27:09.185614 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:27:09.185614 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application with Lock( May 27 08:27:09.185614 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:27:09.185614 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._enter() May 27 08:27:09.185614 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:27:09.185614 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:27:09.185614 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:27:09.185614 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.creator() May 27 08:27:09.185614 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:27:09.185614 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application created_value = creator( May 27 08:27:09.186673 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 08:27:09.186673 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 08:27:09.186673 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 08:27:09.186673 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application May 27 08:27:09.192621 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 231/472] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 08:27:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 08:27:09.193734 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0951a2-79d6-4c1c-bc18-5e6df1beafb2 None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:09.238244 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4b06f8-ed00-415c-bbcf-d60b393d0e90 None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:09.256683 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:09.297723 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4ad4fa-524f-4105-b7fd-573ba7514086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:09.300277 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4ad4fa-524f-4105-b7fd-573ba7514086 None admin] REQUEST_METHOD: `POST` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:09.300850 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4ad4fa-524f-4105-b7fd-573ba7514086 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:09.301341 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4ad4fa-524f-4105-b7fd-573ba7514086 None admin] PATH_INFO: `/v3/users` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:09.302237 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4ad4fa-524f-4105-b7fd-573ba7514086 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:09.304644 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4ad4fa-524f-4105-b7fd-573ba7514086 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:09.330330 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0951a2-79d6-4c1c-bc18-5e6df1beafb2 None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:09.333162 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 242/473] 10.222.0.62 () {60 vars in 1132 bytes} [Fri May 27 08:27:09 2022] POST /identity/v3/users => generated 248 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 08:27:09.376379 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5277f5cf-cc44-4c49-a75e-f9be60e5234a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:09.377863 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5277f5cf-cc44-4c49-a75e-f9be60e5234a None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:09.378217 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5277f5cf-cc44-4c49-a75e-f9be60e5234a None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:09.378532 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5277f5cf-cc44-4c49-a75e-f9be60e5234a None admin] PATH_INFO: `/v3/domains` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:09.379314 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5277f5cf-cc44-4c49-a75e-f9be60e5234a None admin] RBAC: Adding query filter params (name=Default) {{(pid=87173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:27:09.379626 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5277f5cf-cc44-4c49-a75e-f9be60e5234a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:09.383105 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5277f5cf-cc44-4c49-a75e-f9be60e5234a None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:09.395469 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 232/474] 10.222.0.62 () {56 vars in 1109 bytes} [Fri May 27 08:27:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:27:09.401134 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4ad4fa-524f-4105-b7fd-573ba7514086 None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:09.458164 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:09.525022 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4ad4fa-524f-4105-b7fd-573ba7514086 None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:09.566227 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d230a8-1a0d-4b45-b112-fedf2d62b37f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:09.566915 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d230a8-1a0d-4b45-b112-fedf2d62b37f None admin] REQUEST_METHOD: `POST` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:09.567203 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d230a8-1a0d-4b45-b112-fedf2d62b37f None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:09.567482 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d230a8-1a0d-4b45-b112-fedf2d62b37f None admin] PATH_INFO: `/v3/users` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:09.568217 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d230a8-1a0d-4b45-b112-fedf2d62b37f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:09.569734 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d230a8-1a0d-4b45-b112-fedf2d62b37f None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:09.592805 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 243/475] 10.222.0.62 () {60 vars in 1132 bytes} [Fri May 27 08:27:09 2022] POST /identity/v3/users => generated 249 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 08:27:11.193461 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca08ba73-f31b-4e6b-a388-f2d537d16955 None None] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:11.193982 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca08ba73-f31b-4e6b-a388-f2d537d16955 None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:11.194059 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca08ba73-f31b-4e6b-a388-f2d537d16955 None None] PATH_INFO: `/` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:11.195688 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 233/476] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:27:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:27:11.201325 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9b8d1a-0b41-4963-ad72-c35f390ba7d9 None None] REQUEST_METHOD: `POST` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:11.201758 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9b8d1a-0b41-4963-ad72-c35f390ba7d9 None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:11.201936 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9b8d1a-0b41-4963-ad72-c35f390ba7d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:11.219691 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.auth.core [None req-5e9b8d1a-0b41-4963-ad72-c35f390ba7d9 None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:27:11.221964 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.fernet_utils [None req-5e9b8d1a-0b41-4963-ad72-c35f390ba7d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:27:11.296203 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 244/477] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:27:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 08:27:11.327785 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca08ba73-f31b-4e6b-a388-f2d537d16955 None None] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:11.443250 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca08ba73-f31b-4e6b-a388-f2d537d16955 None None] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:11.451741 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:11.479965 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6dfb20-7181-4067-a810-f83abacb3470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:11.480787 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6dfb20-7181-4067-a810-f83abacb3470 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:11.481075 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6dfb20-7181-4067-a810-f83abacb3470 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:11.481447 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6dfb20-7181-4067-a810-f83abacb3470 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:11.493198 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6dfb20-7181-4067-a810-f83abacb3470 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 08:27:11.501229 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application [None req-2e6dfb20-7181-4067-a810-f83abacb3470 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 08:27:11.501229 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:27:11.501229 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:27:11.501229 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:27:11.501229 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:27:11.501229 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:27:11.501229 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:27:11.501229 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:27:11.501229 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:27:11.501229 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:27:11.501229 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:27:11.501229 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:27:11.501229 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 08:27:11.501229 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 08:27:11.501229 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 08:27:11.501229 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 08:27:11.502806 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 08:27:11.502806 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 08:27:11.502806 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 08:27:11.502806 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 08:27:11.502806 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:27:11.502806 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:27:11.502806 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:27:11.502806 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:27:11.502806 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:27:11.502806 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:27:11.502806 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:27:11.502806 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application with Lock( May 27 08:27:11.502806 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:27:11.502806 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._enter() May 27 08:27:11.502806 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:27:11.502806 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:27:11.503607 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:27:11.503607 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.creator() May 27 08:27:11.503607 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:27:11.503607 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application created_value = creator( May 27 08:27:11.503607 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 08:27:11.503607 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 08:27:11.503607 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 08:27:11.503607 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 08:27:11.503607 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 08:27:11.503607 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 08:27:11.503607 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 08:27:11.503607 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application May 27 08:27:11.507433 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 234/478] 10.222.0.62 () {56 vars in 1102 bytes} [Fri May 27 08:27:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 08:27:11.508892 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9b8d1a-0b41-4963-ad72-c35f390ba7d9 None None] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:11.538649 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:11.625986 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9b8d1a-0b41-4963-ad72-c35f390ba7d9 None None] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:11.636277 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8c528f-d442-4062-b1eb-5c1c6b03320b None None] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:11.636632 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8c528f-d442-4062-b1eb-5c1c6b03320b None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:11.636888 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8c528f-d442-4062-b1eb-5c1c6b03320b None None] PATH_INFO: `/` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:11.639777 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 235/479] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:27:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:27:11.645232 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b1c844-19e0-409a-bdec-090f4b267825 None None] REQUEST_METHOD: `POST` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:11.645526 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b1c844-19e0-409a-bdec-090f4b267825 None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:11.645814 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b1c844-19e0-409a-bdec-090f4b267825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:11.667635 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b962f3-d6ca-43cd-936a-f26c3c99f98c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:11.668307 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b962f3-d6ca-43cd-936a-f26c3c99f98c None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:11.668641 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b962f3-d6ca-43cd-936a-f26c3c99f98c None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:11.668901 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b962f3-d6ca-43cd-936a-f26c3c99f98c None admin] PATH_INFO: `/v3/roles` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:11.669114 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.auth.core [None req-b1b1c844-19e0-409a-bdec-090f4b267825 None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:27:11.669660 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b962f3-d6ca-43cd-936a-f26c3c99f98c None admin] RBAC: Adding query filter params (name=service) {{(pid=87172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:27:11.669972 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b962f3-d6ca-43cd-936a-f26c3c99f98c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:11.670970 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.fernet_utils [None req-b1b1c844-19e0-409a-bdec-090f4b267825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:27:11.671367 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b962f3-d6ca-43cd-936a-f26c3c99f98c None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:11.681294 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 245/480] 10.222.0.62 () {56 vars in 1103 bytes} [Fri May 27 08:27:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:27:11.686744 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b962f3-d6ca-43cd-936a-f26c3c99f98c None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:11.753017 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 236/481] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:27:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 08:27:11.774709 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b1c844-19e0-409a-bdec-090f4b267825 None None] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:11.785340 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:11.802738 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b962f3-d6ca-43cd-936a-f26c3c99f98c None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:11.850602 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4255acf-7a16-4c27-9a04-87d5fbf95d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:11.851426 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4255acf-7a16-4c27-9a04-87d5fbf95d70 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:11.851715 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4255acf-7a16-4c27-9a04-87d5fbf95d70 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:11.852243 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4255acf-7a16-4c27-9a04-87d5fbf95d70 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:11.865092 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4255acf-7a16-4c27-9a04-87d5fbf95d70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:11.867034 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4255acf-7a16-4c27-9a04-87d5fbf95d70 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:11.888341 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application [None req-b4255acf-7a16-4c27-9a04-87d5fbf95d70 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 08:27:11.888341 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:27:11.888341 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:27:11.888341 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:27:11.888341 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:27:11.888341 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:27:11.888341 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:27:11.888341 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:27:11.888341 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:27:11.888341 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:27:11.888341 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:27:11.888341 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:27:11.888341 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 08:27:11.888341 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 08:27:11.888341 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 08:27:11.889704 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 08:27:11.889704 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:27:11.889704 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:27:11.889704 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:27:11.889704 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:27:11.889704 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:27:11.889704 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:27:11.889704 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:27:11.889704 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application with Lock( May 27 08:27:11.889704 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:27:11.889704 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._enter() May 27 08:27:11.889704 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:27:11.889704 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:27:11.889704 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:27:11.889704 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.creator() May 27 08:27:11.889704 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:27:11.889704 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application created_value = creator( May 27 08:27:11.890613 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 08:27:11.890613 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 08:27:11.890613 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 08:27:11.890613 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application May 27 08:27:11.890613 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 246/482] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 08:27:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 08:27:11.891237 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f1b993-3ad0-4ad8-ae3a-f820953d1556 None None] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:11.891466 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f1b993-3ad0-4ad8-ae3a-f820953d1556 None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:11.891712 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f1b993-3ad0-4ad8-ae3a-f820953d1556 None None] PATH_INFO: `/` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:11.893141 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:11.894285 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 247/483] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:27:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:27:11.896068 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f1b993-3ad0-4ad8-ae3a-f820953d1556 None None] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:11.906019 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b1c844-19e0-409a-bdec-090f4b267825 None None] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:11.959422 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874955c9-dcbc-434a-b187-3727616b7690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:11.961084 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874955c9-dcbc-434a-b187-3727616b7690 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:11.961805 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874955c9-dcbc-434a-b187-3727616b7690 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:11.962272 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874955c9-dcbc-434a-b187-3727616b7690 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:11.979075 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874955c9-dcbc-434a-b187-3727616b7690 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 08:27:11.993126 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application [None req-874955c9-dcbc-434a-b187-3727616b7690 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 08:27:11.993126 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:27:11.993126 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:27:11.993126 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:27:11.993126 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:27:11.993126 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:27:11.993126 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:27:11.993126 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:27:11.993126 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:27:11.993126 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:27:11.993126 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:27:11.993126 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:27:11.993126 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 08:27:11.993126 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 08:27:11.993126 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 08:27:11.993126 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 08:27:11.994051 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 08:27:11.994051 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 08:27:11.994051 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 08:27:11.994051 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 08:27:11.994051 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:27:11.994051 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:27:11.994051 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:27:11.994051 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:27:11.994051 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:27:11.994051 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:27:11.994051 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:27:11.994051 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application with Lock( May 27 08:27:11.994051 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:27:11.994051 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._enter() May 27 08:27:11.994051 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:27:11.994051 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:27:11.994873 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:27:11.994873 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.creator() May 27 08:27:11.994873 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:27:11.994873 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application created_value = creator( May 27 08:27:11.994873 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 08:27:11.994873 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 08:27:11.994873 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 08:27:11.994873 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 08:27:11.994873 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 08:27:11.994873 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 08:27:11.994873 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 08:27:11.994873 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application May 27 08:27:12.000708 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 237/484] 10.222.0.62 () {56 vars in 1102 bytes} [Fri May 27 08:27:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 08:27:12.000708 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377344a8-cc98-4add-9c0a-9e2f219fd682 None None] REQUEST_METHOD: `POST` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:12.000708 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377344a8-cc98-4add-9c0a-9e2f219fd682 None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:12.000708 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377344a8-cc98-4add-9c0a-9e2f219fd682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:12.015187 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.auth.core [None req-377344a8-cc98-4add-9c0a-9e2f219fd682 None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:27:12.016327 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.fernet_utils [None req-377344a8-cc98-4add-9c0a-9e2f219fd682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:27:12.042354 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f1b993-3ad0-4ad8-ae3a-f820953d1556 None None] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:12.076451 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ad2993-8ac5-41c7-a748-188bc99012e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:12.077146 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ad2993-8ac5-41c7-a748-188bc99012e0 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:12.077500 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ad2993-8ac5-41c7-a748-188bc99012e0 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:12.077709 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ad2993-8ac5-41c7-a748-188bc99012e0 None admin] PATH_INFO: `/v3/domains` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:12.078429 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ad2993-8ac5-41c7-a748-188bc99012e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:27:12.078737 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ad2993-8ac5-41c7-a748-188bc99012e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:12.080841 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ad2993-8ac5-41c7-a748-188bc99012e0 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:12.086097 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 238/485] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:27:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 08:27:12.087473 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377344a8-cc98-4add-9c0a-9e2f219fd682 None None] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:12.096157 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:12.103765 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 248/486] 10.222.0.62 () {56 vars in 1109 bytes} [Fri May 27 08:27:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:27:12.103765 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87095ee5-d69c-4750-96ff-207997ee5079 None None] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:12.103765 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87095ee5-d69c-4750-96ff-207997ee5079 None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:12.103765 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87095ee5-d69c-4750-96ff-207997ee5079 None None] PATH_INFO: `/` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:12.103765 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 249/487] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:27:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:27:12.104849 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87095ee5-d69c-4750-96ff-207997ee5079 None None] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:12.190056 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:12.206275 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377344a8-cc98-4add-9c0a-9e2f219fd682 None None] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:12.221347 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87095ee5-d69c-4750-96ff-207997ee5079 None None] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:12.243997 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d843ab-2620-403b-b095-568e95510c17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:12.244708 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d843ab-2620-403b-b095-568e95510c17 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:12.245001 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d843ab-2620-403b-b095-568e95510c17 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:12.245280 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d843ab-2620-403b-b095-568e95510c17 None admin] PATH_INFO: `/v3/roles` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:12.246043 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d843ab-2620-403b-b095-568e95510c17 None admin] RBAC: Adding query filter params (name=service) {{(pid=87173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:27:12.246356 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d843ab-2620-403b-b095-568e95510c17 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:12.247777 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d843ab-2620-403b-b095-568e95510c17 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:12.256761 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 239/488] 10.222.0.62 () {56 vars in 1103 bytes} [Fri May 27 08:27:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:27:12.258045 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49ecbcb-abab-4f99-92b8-22a9c49181e6 None None] REQUEST_METHOD: `POST` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:12.258344 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49ecbcb-abab-4f99-92b8-22a9c49181e6 None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:12.258626 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49ecbcb-abab-4f99-92b8-22a9c49181e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:12.259459 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149a3e01-74d9-4813-978b-3a91f7824642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:12.260297 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149a3e01-74d9-4813-978b-3a91f7824642 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:12.260538 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149a3e01-74d9-4813-978b-3a91f7824642 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:12.260899 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149a3e01-74d9-4813-978b-3a91f7824642 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:12.268684 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149a3e01-74d9-4813-978b-3a91f7824642 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:12.270051 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149a3e01-74d9-4813-978b-3a91f7824642 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:12.275144 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.auth.core [None req-c49ecbcb-abab-4f99-92b8-22a9c49181e6 None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:27:12.276350 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.fernet_utils [None req-c49ecbcb-abab-4f99-92b8-22a9c49181e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:27:12.285908 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application [None req-149a3e01-74d9-4813-978b-3a91f7824642 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 27 08:27:12.285908 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:27:12.285908 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:27:12.285908 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:27:12.285908 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:27:12.285908 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:27:12.285908 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:27:12.285908 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:27:12.285908 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:27:12.285908 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:27:12.285908 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:27:12.285908 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:27:12.285908 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 08:27:12.285908 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 08:27:12.285908 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 08:27:12.285908 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 08:27:12.287246 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:27:12.287246 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:27:12.287246 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 08:27:12.287246 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 08:27:12.287246 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 08:27:12.287246 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 08:27:12.287246 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:27:12.287246 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:27:12.287246 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:27:12.287246 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:27:12.287246 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:27:12.287246 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application with Lock( May 27 08:27:12.287246 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:27:12.287246 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._enter() May 27 08:27:12.287246 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:27:12.287246 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:27:12.287246 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:27:12.287246 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.creator() May 27 08:27:12.288221 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:27:12.288221 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application created_value = creator( May 27 08:27:12.288221 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 08:27:12.288221 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 08:27:12.288221 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 08:27:12.288221 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 08:27:12.288221 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 08:27:12.288221 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 08:27:12.288221 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 27 08:27:12.288221 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application May 27 08:27:12.288221 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 250/489] 10.222.0.62 () {56 vars in 1093 bytes} [Fri May 27 08:27:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 08:27:12.288823 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149a3e01-74d9-4813-978b-3a91f7824642 None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:12.346403 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 240/490] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:27:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 08:27:12.347391 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49ecbcb-abab-4f99-92b8-22a9c49181e6 None None] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:12.362611 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:12.408271 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149a3e01-74d9-4813-978b-3a91f7824642 None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:12.435585 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:12.445206 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5111b9-d5db-4435-90da-c709a989d239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:12.445991 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5111b9-d5db-4435-90da-c709a989d239 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:12.446290 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5111b9-d5db-4435-90da-c709a989d239 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:12.446544 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5111b9-d5db-4435-90da-c709a989d239 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:12.457244 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5111b9-d5db-4435-90da-c709a989d239 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 08:27:12.458102 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49ecbcb-abab-4f99-92b8-22a9c49181e6 None None] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:12.465037 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application [None req-8d5111b9-d5db-4435-90da-c709a989d239 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 08:27:12.465037 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:27:12.465037 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:27:12.465037 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:27:12.465037 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:27:12.465037 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:27:12.465037 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:27:12.465037 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:27:12.465037 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:27:12.465037 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:27:12.465037 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:27:12.465037 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:27:12.465037 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 08:27:12.465037 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 08:27:12.465037 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 08:27:12.465037 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 08:27:12.465910 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 08:27:12.465910 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 08:27:12.465910 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 08:27:12.465910 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 08:27:12.465910 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:27:12.465910 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:27:12.465910 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:27:12.465910 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:27:12.465910 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:27:12.465910 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:27:12.465910 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:27:12.465910 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application with Lock( May 27 08:27:12.465910 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:27:12.465910 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._enter() May 27 08:27:12.465910 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:27:12.465910 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:27:12.466702 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:27:12.466702 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.creator() May 27 08:27:12.466702 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:27:12.466702 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application created_value = creator( May 27 08:27:12.466702 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 08:27:12.466702 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 08:27:12.466702 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 08:27:12.466702 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 08:27:12.466702 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 08:27:12.466702 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 08:27:12.466702 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 08:27:12.466702 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application May 27 08:27:12.466702 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 251/491] 10.222.0.62 () {56 vars in 1102 bytes} [Fri May 27 08:27:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 08:27:12.467349 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5111b9-d5db-4435-90da-c709a989d239 None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:12.496357 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82496f5-ae40-4d4d-aed2-80b5d2a1508e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:12.497251 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82496f5-ae40-4d4d-aed2-80b5d2a1508e None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:12.497542 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82496f5-ae40-4d4d-aed2-80b5d2a1508e None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:12.497827 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82496f5-ae40-4d4d-aed2-80b5d2a1508e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:12.509519 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82496f5-ae40-4d4d-aed2-80b5d2a1508e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:12.510992 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82496f5-ae40-4d4d-aed2-80b5d2a1508e None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:12.529290 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application [None req-d82496f5-ae40-4d4d-aed2-80b5d2a1508e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 08:27:12.529290 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:27:12.529290 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:27:12.529290 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:27:12.529290 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:27:12.529290 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:27:12.529290 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:27:12.529290 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:27:12.529290 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:27:12.529290 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:27:12.529290 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:27:12.529290 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:27:12.529290 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 08:27:12.529290 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 08:27:12.529290 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 08:27:12.530303 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 08:27:12.530303 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:27:12.530303 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:27:12.530303 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:27:12.530303 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:27:12.530303 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:27:12.530303 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:27:12.530303 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:27:12.530303 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application with Lock( May 27 08:27:12.530303 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:27:12.530303 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._enter() May 27 08:27:12.530303 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:27:12.530303 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:27:12.530303 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:27:12.530303 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.creator() May 27 08:27:12.530303 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:27:12.530303 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application created_value = creator( May 27 08:27:12.531307 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 08:27:12.531307 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 08:27:12.531307 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 08:27:12.531307 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application May 27 08:27:12.531307 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 241/492] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 08:27:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 08:27:12.531307 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82496f5-ae40-4d4d-aed2-80b5d2a1508e None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:12.578315 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5111b9-d5db-4435-90da-c709a989d239 None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:12.599204 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:12.614936 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cd6e5e-67d3-4e82-bd4e-b8bdffcb39f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:12.615608 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cd6e5e-67d3-4e82-bd4e-b8bdffcb39f0 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:12.615896 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cd6e5e-67d3-4e82-bd4e-b8bdffcb39f0 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:12.616178 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cd6e5e-67d3-4e82-bd4e-b8bdffcb39f0 None admin] PATH_INFO: `/v3/users` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:12.617065 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cd6e5e-67d3-4e82-bd4e-b8bdffcb39f0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:27:12.617378 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cd6e5e-67d3-4e82-bd4e-b8bdffcb39f0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:12.618847 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cd6e5e-67d3-4e82-bd4e-b8bdffcb39f0 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:12.633926 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82496f5-ae40-4d4d-aed2-80b5d2a1508e None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:12.657370 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 252/493] 10.222.0.62 () {56 vars in 1133 bytes} [Fri May 27 08:27:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:27:12.658212 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cd6e5e-67d3-4e82-bd4e-b8bdffcb39f0 None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:12.665978 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:12.672342 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea621a64-f303-44c3-b4ce-b5acc9799c56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:12.673167 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea621a64-f303-44c3-b4ce-b5acc9799c56 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:12.674042 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea621a64-f303-44c3-b4ce-b5acc9799c56 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:12.674438 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea621a64-f303-44c3-b4ce-b5acc9799c56 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:12.684519 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea621a64-f303-44c3-b4ce-b5acc9799c56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 08:27:12.692207 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application [None req-ea621a64-f303-44c3-b4ce-b5acc9799c56 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 08:27:12.692207 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:27:12.692207 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:27:12.692207 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:27:12.692207 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:27:12.692207 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:27:12.692207 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:27:12.692207 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:27:12.692207 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:27:12.692207 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:27:12.692207 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:27:12.692207 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:27:12.692207 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 08:27:12.692207 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 08:27:12.692207 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 08:27:12.692207 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 08:27:12.693150 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 08:27:12.693150 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 08:27:12.693150 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 08:27:12.693150 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 08:27:12.693150 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:27:12.693150 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:27:12.693150 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:27:12.693150 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:27:12.693150 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:27:12.693150 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:27:12.693150 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:27:12.693150 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application with Lock( May 27 08:27:12.693150 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:27:12.693150 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._enter() May 27 08:27:12.693150 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:27:12.693150 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:27:12.699196 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:27:12.699196 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.creator() May 27 08:27:12.699196 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:27:12.699196 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application created_value = creator( May 27 08:27:12.699196 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 08:27:12.699196 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 08:27:12.699196 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 08:27:12.699196 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 08:27:12.699196 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 08:27:12.699196 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 08:27:12.699196 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 08:27:12.699196 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application May 27 08:27:12.699196 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 242/494] 10.222.0.62 () {56 vars in 1102 bytes} [Fri May 27 08:27:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 08:27:12.699196 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea621a64-f303-44c3-b4ce-b5acc9799c56 None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:12.758977 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cd6e5e-67d3-4e82-bd4e-b8bdffcb39f0 None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:12.793409 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea621a64-f303-44c3-b4ce-b5acc9799c56 None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:12.795050 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973a7496-01be-4430-bef3-6b3cf0a10499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:12.795711 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973a7496-01be-4430-bef3-6b3cf0a10499 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:12.795988 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973a7496-01be-4430-bef3-6b3cf0a10499 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:12.796258 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973a7496-01be-4430-bef3-6b3cf0a10499 None admin] PATH_INFO: `/v3/roles` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:12.797035 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973a7496-01be-4430-bef3-6b3cf0a10499 None admin] RBAC: Adding query filter params (name=service) {{(pid=87172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:27:12.797335 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973a7496-01be-4430-bef3-6b3cf0a10499 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:12.799284 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973a7496-01be-4430-bef3-6b3cf0a10499 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:12.807272 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 253/495] 10.222.0.62 () {56 vars in 1103 bytes} [Fri May 27 08:27:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:27:12.808058 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973a7496-01be-4430-bef3-6b3cf0a10499 None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:12.833061 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f7a2ca-0380-4fee-8815-d2b2bfbde4a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:12.833994 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f7a2ca-0380-4fee-8815-d2b2bfbde4a5 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:12.833994 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f7a2ca-0380-4fee-8815-d2b2bfbde4a5 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:12.834367 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f7a2ca-0380-4fee-8815-d2b2bfbde4a5 None admin] PATH_INFO: `/v3/domains` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:12.834972 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f7a2ca-0380-4fee-8815-d2b2bfbde4a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:27:12.835294 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f7a2ca-0380-4fee-8815-d2b2bfbde4a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:12.836705 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f7a2ca-0380-4fee-8815-d2b2bfbde4a5 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:12.852442 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 243/496] 10.222.0.62 () {56 vars in 1109 bytes} [Fri May 27 08:27:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:27:12.853298 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f7a2ca-0380-4fee-8815-d2b2bfbde4a5 None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:12.857435 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:12.904793 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:12.919053 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973a7496-01be-4430-bef3-6b3cf0a10499 None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:12.953635 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92e676d-95ed-4d3c-b78a-7ef0d3073075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:12.954288 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92e676d-95ed-4d3c-b78a-7ef0d3073075 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:12.955087 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92e676d-95ed-4d3c-b78a-7ef0d3073075 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:12.955382 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92e676d-95ed-4d3c-b78a-7ef0d3073075 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:12.957774 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f7a2ca-0380-4fee-8815-d2b2bfbde4a5 None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:12.991405 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ac2ffa-41d7-4bc3-bc0f-5f1e008e7148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:12.992071 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ac2ffa-41d7-4bc3-bc0f-5f1e008e7148 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:12.992360 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ac2ffa-41d7-4bc3-bc0f-5f1e008e7148 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:12.992675 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ac2ffa-41d7-4bc3-bc0f-5f1e008e7148 None admin] PATH_INFO: `/v3/roles` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:12.993428 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ac2ffa-41d7-4bc3-bc0f-5f1e008e7148 None admin] RBAC: Adding query filter params (name=service) {{(pid=87173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:27:12.993738 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ac2ffa-41d7-4bc3-bc0f-5f1e008e7148 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:12.995137 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ac2ffa-41d7-4bc3-bc0f-5f1e008e7148 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:13.003947 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 244/497] 10.222.0.62 () {56 vars in 1103 bytes} [Fri May 27 08:27:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:27:13.004732 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ac2ffa-41d7-4bc3-bc0f-5f1e008e7148 None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:13.028091 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92e676d-95ed-4d3c-b78a-7ef0d3073075 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:13.029579 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92e676d-95ed-4d3c-b78a-7ef0d3073075 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:13.070623 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:13.106794 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ac2ffa-41d7-4bc3-bc0f-5f1e008e7148 None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:13.119414 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:13.138430 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 254/498] 10.222.0.62 () {58 vars in 1282 bytes} [Fri May 27 08:27:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 08:27:13.139892 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92e676d-95ed-4d3c-b78a-7ef0d3073075 None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:13.144856 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e958af85-26a9-4777-a561-9c3d965e2738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:13.145652 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e958af85-26a9-4777-a561-9c3d965e2738 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:13.145938 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e958af85-26a9-4777-a561-9c3d965e2738 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:13.146215 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e958af85-26a9-4777-a561-9c3d965e2738 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:13.157399 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e958af85-26a9-4777-a561-9c3d965e2738 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:13.159731 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e958af85-26a9-4777-a561-9c3d965e2738 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:13.177476 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application [None req-e958af85-26a9-4777-a561-9c3d965e2738 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 08:27:13.177476 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:27:13.177476 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:27:13.177476 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:27:13.177476 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:27:13.177476 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:27:13.177476 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:27:13.177476 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:27:13.177476 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:27:13.177476 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:27:13.177476 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:27:13.177476 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:27:13.177476 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 08:27:13.177476 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 08:27:13.177476 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 08:27:13.178526 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 08:27:13.178526 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:27:13.178526 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:27:13.178526 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:27:13.178526 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:27:13.178526 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:27:13.178526 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:27:13.178526 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:27:13.178526 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application with Lock( May 27 08:27:13.178526 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:27:13.178526 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._enter() May 27 08:27:13.178526 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:27:13.178526 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:27:13.178526 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:27:13.178526 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.creator() May 27 08:27:13.178526 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:27:13.178526 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application created_value = creator( May 27 08:27:13.179364 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 08:27:13.179364 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 08:27:13.179364 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 08:27:13.179364 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application May 27 08:27:13.179364 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 245/499] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 08:27:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 08:27:13.179644 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e958af85-26a9-4777-a561-9c3d965e2738 None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:13.249144 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92e676d-95ed-4d3c-b78a-7ef0d3073075 None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:13.292038 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e958af85-26a9-4777-a561-9c3d965e2738 None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:13.292656 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eea109-bbd2-4e40-b16f-0e698a9bea26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:13.293181 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eea109-bbd2-4e40-b16f-0e698a9bea26 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:13.293499 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eea109-bbd2-4e40-b16f-0e698a9bea26 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:13.293735 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eea109-bbd2-4e40-b16f-0e698a9bea26 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:13.302039 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48eea109-bbd2-4e40-b16f-0e698a9bea26 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:13.303564 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48eea109-bbd2-4e40-b16f-0e698a9bea26 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:13.306645 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:13.319867 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application [None req-48eea109-bbd2-4e40-b16f-0e698a9bea26 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 27 08:27:13.319867 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:27:13.319867 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:27:13.319867 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:27:13.319867 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:27:13.319867 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:27:13.319867 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:27:13.319867 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:27:13.319867 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:27:13.319867 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:27:13.319867 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:27:13.319867 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:27:13.319867 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 08:27:13.319867 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 08:27:13.319867 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 08:27:13.319867 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 08:27:13.321049 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:27:13.321049 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:27:13.321049 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 08:27:13.321049 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 08:27:13.321049 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 08:27:13.321049 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 08:27:13.321049 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:27:13.321049 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:27:13.321049 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:27:13.321049 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:27:13.321049 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:27:13.321049 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application with Lock( May 27 08:27:13.321049 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:27:13.321049 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._enter() May 27 08:27:13.321049 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:27:13.321049 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:27:13.321049 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:27:13.321049 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.creator() May 27 08:27:13.322039 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:27:13.322039 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application created_value = creator( May 27 08:27:13.322039 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 08:27:13.322039 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 08:27:13.322039 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 08:27:13.322039 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 08:27:13.322039 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 08:27:13.322039 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 08:27:13.322039 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 27 08:27:13.322039 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application May 27 08:27:13.322039 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 255/500] 10.222.0.62 () {56 vars in 1099 bytes} [Fri May 27 08:27:13 2022] GET /identity/v3/users/cinder => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 08:27:13.326634 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eea109-bbd2-4e40-b16f-0e698a9bea26 None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:13.327261 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eb7b48-7e79-42dc-a374-d9dce8d240bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:13.328056 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eb7b48-7e79-42dc-a374-d9dce8d240bf None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:13.328350 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eb7b48-7e79-42dc-a374-d9dce8d240bf None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:13.328662 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eb7b48-7e79-42dc-a374-d9dce8d240bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:13.339692 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7eb7b48-7e79-42dc-a374-d9dce8d240bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:13.341216 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7eb7b48-7e79-42dc-a374-d9dce8d240bf None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:13.358721 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application [None req-e7eb7b48-7e79-42dc-a374-d9dce8d240bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 08:27:13.358721 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:27:13.358721 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:27:13.358721 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:27:13.358721 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:27:13.358721 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:27:13.358721 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:27:13.358721 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:27:13.358721 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:27:13.358721 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:27:13.358721 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:27:13.358721 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:27:13.358721 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 08:27:13.358721 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 08:27:13.358721 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 08:27:13.359752 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 08:27:13.359752 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:27:13.359752 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:27:13.359752 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:27:13.359752 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:27:13.359752 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:27:13.359752 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:27:13.359752 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:27:13.359752 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application with Lock( May 27 08:27:13.359752 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:27:13.359752 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._enter() May 27 08:27:13.359752 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:27:13.359752 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:27:13.359752 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:27:13.359752 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.creator() May 27 08:27:13.359752 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:27:13.359752 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application created_value = creator( May 27 08:27:13.360915 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 08:27:13.360915 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 08:27:13.360915 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 08:27:13.360915 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application May 27 08:27:13.360915 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 246/501] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 08:27:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 08:27:13.360915 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eb7b48-7e79-42dc-a374-d9dce8d240bf None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:13.382662 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:13.433065 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eea109-bbd2-4e40-b16f-0e698a9bea26 None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:13.464909 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eb7b48-7e79-42dc-a374-d9dce8d240bf None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:13.466520 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff010b20-48d8-4b5c-9424-a35fac265199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:13.467313 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff010b20-48d8-4b5c-9424-a35fac265199 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:13.467602 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff010b20-48d8-4b5c-9424-a35fac265199 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:13.467880 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff010b20-48d8-4b5c-9424-a35fac265199 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:13.478640 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff010b20-48d8-4b5c-9424-a35fac265199 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:13.480109 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff010b20-48d8-4b5c-9424-a35fac265199 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:13.500085 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application [None req-ff010b20-48d8-4b5c-9424-a35fac265199 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 08:27:13.500085 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:27:13.500085 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:27:13.500085 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:27:13.500085 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:27:13.500085 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:27:13.500085 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:27:13.500085 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:27:13.500085 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:27:13.500085 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:27:13.500085 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:27:13.500085 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:27:13.500085 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 08:27:13.500085 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 08:27:13.500085 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 08:27:13.501218 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 08:27:13.501218 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:27:13.501218 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:27:13.501218 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:27:13.501218 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:27:13.501218 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:27:13.501218 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:27:13.501218 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:27:13.501218 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application with Lock( May 27 08:27:13.501218 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:27:13.501218 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._enter() May 27 08:27:13.501218 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:27:13.501218 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:27:13.501218 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:27:13.501218 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.creator() May 27 08:27:13.501218 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:27:13.501218 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application created_value = creator( May 27 08:27:13.502141 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 08:27:13.502141 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 08:27:13.502141 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 08:27:13.502141 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application May 27 08:27:13.502141 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 256/502] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 08:27:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 08:27:13.502141 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff010b20-48d8-4b5c-9424-a35fac265199 None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:13.502461 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56043ff1-2ff6-46ac-8868-e26a391c0835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:13.503162 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56043ff1-2ff6-46ac-8868-e26a391c0835 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:13.503453 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56043ff1-2ff6-46ac-8868-e26a391c0835 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:13.503734 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56043ff1-2ff6-46ac-8868-e26a391c0835 None admin] PATH_INFO: `/v3/domains` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:13.504462 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56043ff1-2ff6-46ac-8868-e26a391c0835 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:27:13.504803 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56043ff1-2ff6-46ac-8868-e26a391c0835 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:13.506293 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56043ff1-2ff6-46ac-8868-e26a391c0835 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:13.518414 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 247/503] 10.222.0.62 () {56 vars in 1109 bytes} [Fri May 27 08:27:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:27:13.519268 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56043ff1-2ff6-46ac-8868-e26a391c0835 None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:13.562478 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:13.598586 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:13.613142 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff010b20-48d8-4b5c-9424-a35fac265199 None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:13.627918 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56043ff1-2ff6-46ac-8868-e26a391c0835 None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:13.650462 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc9b06e-cbe7-4f0d-83ab-2a845017b5e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:13.651137 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc9b06e-cbe7-4f0d-83ab-2a845017b5e4 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:13.651423 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc9b06e-cbe7-4f0d-83ab-2a845017b5e4 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:13.651706 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc9b06e-cbe7-4f0d-83ab-2a845017b5e4 None admin] PATH_INFO: `/v3/users` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:13.652551 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc9b06e-cbe7-4f0d-83ab-2a845017b5e4 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:27:13.652895 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc9b06e-cbe7-4f0d-83ab-2a845017b5e4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:13.654360 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc9b06e-cbe7-4f0d-83ab-2a845017b5e4 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:13.666573 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c82f95b-5359-4e66-be93-499d96051aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:13.667225 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c82f95b-5359-4e66-be93-499d96051aad None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:13.667507 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c82f95b-5359-4e66-be93-499d96051aad None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:13.667782 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c82f95b-5359-4e66-be93-499d96051aad None admin] PATH_INFO: `/v3/domains` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:13.668544 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c82f95b-5359-4e66-be93-499d96051aad None admin] RBAC: Adding query filter params (name=Default) {{(pid=87173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:27:13.668831 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c82f95b-5359-4e66-be93-499d96051aad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:13.670199 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c82f95b-5359-4e66-be93-499d96051aad None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:13.673135 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 257/504] 10.222.0.62 () {56 vars in 1137 bytes} [Fri May 27 08:27:13 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:27:13.674113 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc9b06e-cbe7-4f0d-83ab-2a845017b5e4 None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:13.682190 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 248/505] 10.222.0.62 () {56 vars in 1109 bytes} [Fri May 27 08:27:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:27:13.682895 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c82f95b-5359-4e66-be93-499d96051aad None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:13.776156 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc9b06e-cbe7-4f0d-83ab-2a845017b5e4 None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:13.785893 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c82f95b-5359-4e66-be93-499d96051aad None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:13.787485 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:13.812906 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ac07b2-f2eb-47d0-91ac-9613c958693f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:13.813572 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ac07b2-f2eb-47d0-91ac-9613c958693f None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:13.813886 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ac07b2-f2eb-47d0-91ac-9613c958693f None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:13.814679 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ac07b2-f2eb-47d0-91ac-9613c958693f None admin] PATH_INFO: `/v3/domains` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:13.815413 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ac07b2-f2eb-47d0-91ac-9613c958693f None admin] RBAC: Adding query filter params (name=Default) {{(pid=87172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:27:13.815725 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ac07b2-f2eb-47d0-91ac-9613c958693f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:13.817171 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ac07b2-f2eb-47d0-91ac-9613c958693f None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:13.820742 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06beb311-4e7a-4548-bceb-4133e2925da8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:13.821547 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06beb311-4e7a-4548-bceb-4133e2925da8 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:13.821827 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06beb311-4e7a-4548-bceb-4133e2925da8 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:13.822095 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06beb311-4e7a-4548-bceb-4133e2925da8 None admin] PATH_INFO: `/v3/users/glance` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:13.825031 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:13.830862 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06beb311-4e7a-4548-bceb-4133e2925da8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:13.830996 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 258/506] 10.222.0.62 () {56 vars in 1109 bytes} [Fri May 27 08:27:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:27:13.831716 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ac07b2-f2eb-47d0-91ac-9613c958693f None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:13.833155 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06beb311-4e7a-4548-bceb-4133e2925da8 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:13.851509 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application [None req-06beb311-4e7a-4548-bceb-4133e2925da8 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 27 08:27:13.851509 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:27:13.851509 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:27:13.851509 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:27:13.851509 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:27:13.851509 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:27:13.851509 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:27:13.851509 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:27:13.851509 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:27:13.851509 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:27:13.851509 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:27:13.851509 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:27:13.851509 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 08:27:13.851509 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 08:27:13.851509 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 08:27:13.851509 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 08:27:13.852444 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:27:13.852444 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:27:13.852444 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 08:27:13.852444 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 08:27:13.852444 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 08:27:13.852444 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 08:27:13.852444 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:27:13.852444 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:27:13.852444 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:27:13.852444 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:27:13.852444 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:27:13.852444 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application with Lock( May 27 08:27:13.852444 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:27:13.852444 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._enter() May 27 08:27:13.852444 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:27:13.852444 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:27:13.852444 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:27:13.852444 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.creator() May 27 08:27:13.853393 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:27:13.853393 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application created_value = creator( May 27 08:27:13.853393 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 08:27:13.853393 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 08:27:13.853393 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 08:27:13.853393 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 08:27:13.853393 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 08:27:13.853393 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 08:27:13.853393 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 27 08:27:13.853393 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application May 27 08:27:13.853393 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 249/507] 10.222.0.62 () {56 vars in 1099 bytes} [Fri May 27 08:27:13 2022] GET /identity/v3/users/glance => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 08:27:13.853947 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06beb311-4e7a-4548-bceb-4133e2925da8 None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:13.939030 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ac07b2-f2eb-47d0-91ac-9613c958693f None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:13.956330 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06beb311-4e7a-4548-bceb-4133e2925da8 None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:13.974756 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416c6efb-bbbc-4633-a463-62ec3a3a75b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:13.975406 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416c6efb-bbbc-4633-a463-62ec3a3a75b9 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:13.975696 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416c6efb-bbbc-4633-a463-62ec3a3a75b9 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:13.975978 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416c6efb-bbbc-4633-a463-62ec3a3a75b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:13.991454 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c89677-ce63-4a18-a5b6-c7d8d8a35d60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:13.992247 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c89677-ce63-4a18-a5b6-c7d8d8a35d60 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:13.992532 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c89677-ce63-4a18-a5b6-c7d8d8a35d60 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:13.992843 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c89677-ce63-4a18-a5b6-c7d8d8a35d60 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:14.000263 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c89677-ce63-4a18-a5b6-c7d8d8a35d60 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:14.002324 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c89677-ce63-4a18-a5b6-c7d8d8a35d60 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:14.017693 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application [None req-a5c89677-ce63-4a18-a5b6-c7d8d8a35d60 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 27 08:27:14.017693 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:27:14.017693 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:27:14.017693 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:27:14.017693 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:27:14.017693 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:27:14.017693 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:27:14.017693 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:27:14.017693 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:27:14.017693 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:27:14.017693 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:27:14.017693 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:27:14.017693 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 08:27:14.017693 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 08:27:14.017693 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 08:27:14.017693 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 08:27:14.019173 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:27:14.019173 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:27:14.019173 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 08:27:14.019173 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 08:27:14.019173 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 08:27:14.019173 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 08:27:14.019173 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:27:14.019173 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:27:14.019173 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:27:14.019173 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:27:14.019173 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:27:14.019173 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application with Lock( May 27 08:27:14.019173 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:27:14.019173 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._enter() May 27 08:27:14.019173 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:27:14.019173 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:27:14.019173 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:27:14.019173 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.creator() May 27 08:27:14.021084 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:27:14.021084 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application created_value = creator( May 27 08:27:14.021084 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 08:27:14.021084 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 08:27:14.021084 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 08:27:14.021084 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 08:27:14.021084 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 08:27:14.021084 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 08:27:14.021084 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 27 08:27:14.021084 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application May 27 08:27:14.021638 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:14.021719 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 250/508] 10.222.0.62 () {56 vars in 1102 bytes} [Fri May 27 08:27:13 2022] GET /identity/v3/users/neutron => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 08:27:14.021719 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c89677-ce63-4a18-a5b6-c7d8d8a35d60 None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:14.051935 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416c6efb-bbbc-4633-a463-62ec3a3a75b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:14.053437 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416c6efb-bbbc-4633-a463-62ec3a3a75b9 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:14.080681 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:14.129501 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c89677-ce63-4a18-a5b6-c7d8d8a35d60 None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:14.158976 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 259/509] 10.222.0.62 () {58 vars in 1282 bytes} [Fri May 27 08:27:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 08:27:14.159817 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416c6efb-bbbc-4633-a463-62ec3a3a75b9 None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:14.167283 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df19c5b-3327-4620-b40c-2c6663cbb7de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:14.168081 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df19c5b-3327-4620-b40c-2c6663cbb7de None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:14.168366 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df19c5b-3327-4620-b40c-2c6663cbb7de None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:14.168675 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df19c5b-3327-4620-b40c-2c6663cbb7de None admin] PATH_INFO: `/v3/projects/service` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:14.175767 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df19c5b-3327-4620-b40c-2c6663cbb7de None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:14.177288 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df19c5b-3327-4620-b40c-2c6663cbb7de None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:14.192827 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application [None req-9df19c5b-3327-4620-b40c-2c6663cbb7de None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 08:27:14.192827 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:27:14.192827 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:27:14.192827 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:27:14.192827 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:27:14.192827 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:27:14.192827 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:27:14.192827 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:27:14.192827 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:27:14.192827 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:27:14.192827 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:27:14.192827 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:27:14.192827 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 08:27:14.192827 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 08:27:14.192827 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 08:27:14.193840 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 08:27:14.193840 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:27:14.193840 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:27:14.193840 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:27:14.193840 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:27:14.193840 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:27:14.193840 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:27:14.193840 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:27:14.193840 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application with Lock( May 27 08:27:14.193840 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:27:14.193840 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._enter() May 27 08:27:14.193840 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:27:14.193840 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:27:14.193840 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:27:14.193840 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.creator() May 27 08:27:14.193840 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:27:14.193840 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application created_value = creator( May 27 08:27:14.194741 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 08:27:14.194741 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 08:27:14.194741 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 08:27:14.194741 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 08:27:14.194741 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 08:27:14.194741 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 08:27:14.194741 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 08:27:14.194741 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application May 27 08:27:14.194741 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 251/510] 10.222.0.62 () {56 vars in 1111 bytes} [Fri May 27 08:27:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 08:27:14.195262 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df19c5b-3327-4620-b40c-2c6663cbb7de None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:14.233814 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:14.268453 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416c6efb-bbbc-4633-a463-62ec3a3a75b9 None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:14.295507 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df19c5b-3327-4620-b40c-2c6663cbb7de None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:14.302694 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4d2c79-a683-4c8a-bd14-65a5e5176d64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:14.303348 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4d2c79-a683-4c8a-bd14-65a5e5176d64 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:14.303634 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4d2c79-a683-4c8a-bd14-65a5e5176d64 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:14.303902 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4d2c79-a683-4c8a-bd14-65a5e5176d64 None admin] PATH_INFO: `/v3/users` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:14.304767 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4d2c79-a683-4c8a-bd14-65a5e5176d64 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:27:14.305073 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4d2c79-a683-4c8a-bd14-65a5e5176d64 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:14.306496 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4d2c79-a683-4c8a-bd14-65a5e5176d64 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:14.312835 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:14.324688 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 260/511] 10.222.0.62 () {56 vars in 1137 bytes} [Fri May 27 08:27:14 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:27:14.325502 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4d2c79-a683-4c8a-bd14-65a5e5176d64 None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:14.335510 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637f4b18-3b8d-4908-a682-f435577bfa55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:14.336300 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637f4b18-3b8d-4908-a682-f435577bfa55 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:14.336607 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637f4b18-3b8d-4908-a682-f435577bfa55 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:14.336897 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637f4b18-3b8d-4908-a682-f435577bfa55 None admin] PATH_INFO: `/v3/users` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:14.337743 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637f4b18-3b8d-4908-a682-f435577bfa55 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:27:14.338051 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637f4b18-3b8d-4908-a682-f435577bfa55 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:14.339514 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637f4b18-3b8d-4908-a682-f435577bfa55 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:14.377285 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 252/512] 10.222.0.62 () {56 vars in 1139 bytes} [Fri May 27 08:27:14 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:27:14.378370 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637f4b18-3b8d-4908-a682-f435577bfa55 None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:14.433789 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4d2c79-a683-4c8a-bd14-65a5e5176d64 None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:14.462912 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:14.471580 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9566d61c-c78f-477f-a029-ab5cc12e58df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:14.472362 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9566d61c-c78f-477f-a029-ab5cc12e58df None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:14.472679 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9566d61c-c78f-477f-a029-ab5cc12e58df None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:14.472962 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9566d61c-c78f-477f-a029-ab5cc12e58df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:14.480427 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637f4b18-3b8d-4908-a682-f435577bfa55 None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:14.483015 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9566d61c-c78f-477f-a029-ab5cc12e58df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:14.484471 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9566d61c-c78f-477f-a029-ab5cc12e58df None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:14.502002 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application [None req-9566d61c-c78f-477f-a029-ab5cc12e58df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 08:27:14.502002 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:27:14.502002 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:27:14.502002 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:27:14.502002 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:27:14.502002 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:27:14.502002 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:27:14.502002 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:27:14.502002 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:27:14.502002 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:27:14.502002 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:27:14.502002 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:27:14.502002 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 08:27:14.502002 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 08:27:14.502002 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 08:27:14.503163 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 08:27:14.503163 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:27:14.503163 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:27:14.503163 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:27:14.503163 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:27:14.503163 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:27:14.503163 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:27:14.503163 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:27:14.503163 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application with Lock( May 27 08:27:14.503163 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:27:14.503163 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._enter() May 27 08:27:14.503163 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:27:14.503163 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:27:14.503163 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:27:14.503163 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.creator() May 27 08:27:14.503163 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:27:14.503163 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application created_value = creator( May 27 08:27:14.504040 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 08:27:14.504040 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 08:27:14.504040 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 08:27:14.504040 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application May 27 08:27:14.504040 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 261/513] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 08:27:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 08:27:14.504040 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9566d61c-c78f-477f-a029-ab5cc12e58df None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:14.519112 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b321ba9-81a9-499b-86db-fe82847a4f2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:14.519770 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b321ba9-81a9-499b-86db-fe82847a4f2f None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:14.520055 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b321ba9-81a9-499b-86db-fe82847a4f2f None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:14.520335 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b321ba9-81a9-499b-86db-fe82847a4f2f None admin] PATH_INFO: `/v3/projects` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:14.521181 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b321ba9-81a9-499b-86db-fe82847a4f2f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:27:14.521497 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b321ba9-81a9-499b-86db-fe82847a4f2f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:14.522978 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b321ba9-81a9-499b-86db-fe82847a4f2f None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:14.542391 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 253/514] 10.222.0.62 () {56 vars in 1148 bytes} [Fri May 27 08:27:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:27:14.543243 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b321ba9-81a9-499b-86db-fe82847a4f2f None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:14.579290 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:14.606463 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9566d61c-c78f-477f-a029-ab5cc12e58df None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:14.650536 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d370279-4201-4682-9ee7-68fe0ff0ab9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:14.651191 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d370279-4201-4682-9ee7-68fe0ff0ab9d None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:14.651477 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d370279-4201-4682-9ee7-68fe0ff0ab9d None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:14.651758 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d370279-4201-4682-9ee7-68fe0ff0ab9d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:14.660264 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b321ba9-81a9-499b-86db-fe82847a4f2f None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:14.698826 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20b1be3-13e8-4ede-b695-02cdad255fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:14.699394 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20b1be3-13e8-4ede-b695-02cdad255fc3 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:14.699682 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20b1be3-13e8-4ede-b695-02cdad255fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:14.699962 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20b1be3-13e8-4ede-b695-02cdad255fc3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:14.706394 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:14.727019 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d370279-4201-4682-9ee7-68fe0ff0ab9d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:14.728486 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d370279-4201-4682-9ee7-68fe0ff0ab9d None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:14.771845 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20b1be3-13e8-4ede-b695-02cdad255fc3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:14.773397 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20b1be3-13e8-4ede-b695-02cdad255fc3 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:14.834327 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 262/515] 10.222.0.62 () {58 vars in 1282 bytes} [Fri May 27 08:27:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 08:27:14.835468 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d370279-4201-4682-9ee7-68fe0ff0ab9d None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:14.926949 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:14.929024 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:14.958924 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d370279-4201-4682-9ee7-68fe0ff0ab9d None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:15.002695 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4510063e-7d8b-4402-ac2a-d653eed7d160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:15.003360 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4510063e-7d8b-4402-ac2a-d653eed7d160 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:15.003643 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4510063e-7d8b-4402-ac2a-d653eed7d160 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:15.003926 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4510063e-7d8b-4402-ac2a-d653eed7d160 None admin] PATH_INFO: `/v3/domains` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:15.004692 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4510063e-7d8b-4402-ac2a-d653eed7d160 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:27:15.005010 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4510063e-7d8b-4402-ac2a-d653eed7d160 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:15.006404 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4510063e-7d8b-4402-ac2a-d653eed7d160 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:15.008944 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 254/516] 10.222.0.62 () {58 vars in 1282 bytes} [Fri May 27 08:27:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 08:27:15.009826 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20b1be3-13e8-4ede-b695-02cdad255fc3 None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:15.029920 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 263/517] 10.222.0.62 () {56 vars in 1109 bytes} [Fri May 27 08:27:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:27:15.029920 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4510063e-7d8b-4402-ac2a-d653eed7d160 None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:15.121546 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20b1be3-13e8-4ede-b695-02cdad255fc3 None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:15.134605 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4510063e-7d8b-4402-ac2a-d653eed7d160 None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:15.156872 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cab414-d952-4214-b1ae-ad23349fd77f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:15.157554 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cab414-d952-4214-b1ae-ad23349fd77f None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:15.158044 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cab414-d952-4214-b1ae-ad23349fd77f None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:15.158325 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cab414-d952-4214-b1ae-ad23349fd77f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:15.159159 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cab414-d952-4214-b1ae-ad23349fd77f None admin] RBAC: Adding query filter params (role.id=d15a26a31e9f4cad8e2c934cf892d50d, scope.project.id=256f4731060449f1b80067e51e8bec00, user.id=3a09bdc2dbac4f9abe450ff121e7dce8) {{(pid=87173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:27:15.159478 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cab414-d952-4214-b1ae-ad23349fd77f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:15.161229 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cab414-d952-4214-b1ae-ad23349fd77f None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:15.163308 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:15.167964 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 255/518] 10.222.0.62 () {56 vars in 1374 bytes} [Fri May 27 08:27:15 2022] GET /identity/v3/role_assignments?user.id=3a09bdc2dbac4f9abe450ff121e7dce8&scope.project.id=256f4731060449f1b80067e51e8bec00&role.id=d15a26a31e9f4cad8e2c934cf892d50d => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:27:15.168948 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cab414-d952-4214-b1ae-ad23349fd77f None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:15.170963 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9678ec66-2f08-4db2-a260-1f5669ea22ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:15.171886 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9678ec66-2f08-4db2-a260-1f5669ea22ed None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:15.172173 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9678ec66-2f08-4db2-a260-1f5669ea22ed None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:15.172569 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9678ec66-2f08-4db2-a260-1f5669ea22ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:15.184272 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:15.187607 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9678ec66-2f08-4db2-a260-1f5669ea22ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:15.190002 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9678ec66-2f08-4db2-a260-1f5669ea22ed None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:15.214409 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application [None req-9678ec66-2f08-4db2-a260-1f5669ea22ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 08:27:15.214409 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:27:15.214409 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:27:15.214409 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:27:15.214409 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:27:15.214409 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:27:15.214409 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:27:15.214409 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:27:15.214409 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:27:15.214409 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:27:15.214409 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:27:15.214409 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:27:15.214409 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 08:27:15.214409 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 08:27:15.214409 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 08:27:15.215315 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 08:27:15.215315 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:27:15.215315 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:27:15.215315 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:27:15.215315 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:27:15.215315 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:27:15.215315 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:27:15.215315 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:27:15.215315 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application with Lock( May 27 08:27:15.215315 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:27:15.215315 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._enter() May 27 08:27:15.215315 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:27:15.215315 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:27:15.215315 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:27:15.215315 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.creator() May 27 08:27:15.215315 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:27:15.215315 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application created_value = creator( May 27 08:27:15.216172 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 08:27:15.216172 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 08:27:15.216172 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 08:27:15.216172 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application May 27 08:27:15.216172 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 264/519] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 08:27:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 08:27:15.216956 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9678ec66-2f08-4db2-a260-1f5669ea22ed None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:15.303565 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cab414-d952-4214-b1ae-ad23349fd77f None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:15.338018 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9678ec66-2f08-4db2-a260-1f5669ea22ed None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:15.347200 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab91460-aaa6-4421-8cde-03c6769a5323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:15.348020 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab91460-aaa6-4421-8cde-03c6769a5323 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:15.348297 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab91460-aaa6-4421-8cde-03c6769a5323 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:15.348570 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab91460-aaa6-4421-8cde-03c6769a5323 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:15.362725 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab91460-aaa6-4421-8cde-03c6769a5323 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:15.364512 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab91460-aaa6-4421-8cde-03c6769a5323 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:15.382278 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c05b54-d575-41cd-8ff1-3e15705326ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:15.383086 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c05b54-d575-41cd-8ff1-3e15705326ec None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:15.383375 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c05b54-d575-41cd-8ff1-3e15705326ec None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:15.383652 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c05b54-d575-41cd-8ff1-3e15705326ec None admin] PATH_INFO: `/v3/projects/service` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:15.385659 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application [None req-1ab91460-aaa6-4421-8cde-03c6769a5323 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 08:27:15.385659 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:27:15.385659 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:27:15.385659 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:27:15.385659 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:27:15.385659 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:27:15.385659 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:27:15.385659 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:27:15.385659 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:27:15.385659 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:27:15.385659 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:27:15.385659 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:27:15.385659 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 08:27:15.385659 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 08:27:15.385659 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 08:27:15.386670 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 08:27:15.386670 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:27:15.386670 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:27:15.386670 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:27:15.386670 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:27:15.386670 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:27:15.386670 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:27:15.386670 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:27:15.386670 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application with Lock( May 27 08:27:15.386670 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:27:15.386670 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._enter() May 27 08:27:15.386670 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:27:15.386670 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:27:15.386670 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:27:15.386670 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.creator() May 27 08:27:15.386670 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:27:15.386670 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application created_value = creator( May 27 08:27:15.387711 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 08:27:15.387711 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 08:27:15.387711 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 08:27:15.387711 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application May 27 08:27:15.388732 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 256/520] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 08:27:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 08:27:15.389841 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab91460-aaa6-4421-8cde-03c6769a5323 None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:15.398066 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c05b54-d575-41cd-8ff1-3e15705326ec None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:15.399532 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c05b54-d575-41cd-8ff1-3e15705326ec None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:15.416445 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application [None req-e3c05b54-d575-41cd-8ff1-3e15705326ec None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 08:27:15.416445 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:27:15.416445 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:27:15.416445 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:27:15.416445 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:27:15.416445 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:27:15.416445 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:27:15.416445 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:27:15.416445 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:27:15.416445 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:27:15.416445 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:27:15.416445 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:27:15.416445 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 08:27:15.416445 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 08:27:15.416445 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 08:27:15.417390 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 08:27:15.417390 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:27:15.417390 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:27:15.417390 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:27:15.417390 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:27:15.417390 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:27:15.417390 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:27:15.417390 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:27:15.417390 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application with Lock( May 27 08:27:15.417390 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:27:15.417390 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._enter() May 27 08:27:15.417390 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:27:15.417390 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:27:15.417390 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:27:15.417390 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.creator() May 27 08:27:15.417390 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:27:15.417390 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application created_value = creator( May 27 08:27:15.418218 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 08:27:15.418218 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 08:27:15.418218 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 08:27:15.418218 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 08:27:15.418218 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 08:27:15.418218 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 08:27:15.418218 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 08:27:15.418218 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application May 27 08:27:15.418218 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 265/521] 10.222.0.62 () {56 vars in 1111 bytes} [Fri May 27 08:27:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 08:27:15.418685 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c05b54-d575-41cd-8ff1-3e15705326ec None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:15.447365 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:15.479946 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:15.505574 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab91460-aaa6-4421-8cde-03c6769a5323 None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:15.538118 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c05b54-d575-41cd-8ff1-3e15705326ec None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:15.542680 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790931b4-0a0c-4b74-9e27-465193d684f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:15.543352 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790931b4-0a0c-4b74-9e27-465193d684f6 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:15.543639 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790931b4-0a0c-4b74-9e27-465193d684f6 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:15.543918 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790931b4-0a0c-4b74-9e27-465193d684f6 None admin] PATH_INFO: `/v3/domains` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:15.544683 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790931b4-0a0c-4b74-9e27-465193d684f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:27:15.544995 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790931b4-0a0c-4b74-9e27-465193d684f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:15.546433 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790931b4-0a0c-4b74-9e27-465193d684f6 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:15.560276 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 257/522] 10.222.0.62 () {56 vars in 1109 bytes} [Fri May 27 08:27:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:27:15.565775 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790931b4-0a0c-4b74-9e27-465193d684f6 None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:15.578949 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa5be59-a836-43a0-a8c3-cd5134d6a42d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:15.579926 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa5be59-a836-43a0-a8c3-cd5134d6a42d None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:15.580507 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa5be59-a836-43a0-a8c3-cd5134d6a42d None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:15.580875 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa5be59-a836-43a0-a8c3-cd5134d6a42d None admin] PATH_INFO: `/v3/domains` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:15.581618 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa5be59-a836-43a0-a8c3-cd5134d6a42d None admin] RBAC: Adding query filter params (name=Default) {{(pid=87172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:27:15.581929 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa5be59-a836-43a0-a8c3-cd5134d6a42d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:15.583381 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa5be59-a836-43a0-a8c3-cd5134d6a42d None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:15.601277 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 266/523] 10.222.0.62 () {56 vars in 1109 bytes} [Fri May 27 08:27:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:27:15.601277 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa5be59-a836-43a0-a8c3-cd5134d6a42d None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:15.687380 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790931b4-0a0c-4b74-9e27-465193d684f6 None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:15.698845 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:15.715876 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa5be59-a836-43a0-a8c3-cd5134d6a42d None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:15.725620 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7302acb0-ebe8-4b31-bc18-32b40d7e918c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:15.726353 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7302acb0-ebe8-4b31-bc18-32b40d7e918c None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:15.726639 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7302acb0-ebe8-4b31-bc18-32b40d7e918c None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:15.726922 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7302acb0-ebe8-4b31-bc18-32b40d7e918c None admin] PATH_INFO: `/v3/projects` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:15.727714 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7302acb0-ebe8-4b31-bc18-32b40d7e918c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:27:15.728029 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7302acb0-ebe8-4b31-bc18-32b40d7e918c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:15.729760 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7302acb0-ebe8-4b31-bc18-32b40d7e918c None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:15.730893 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:15.748180 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 258/524] 10.222.0.62 () {56 vars in 1148 bytes} [Fri May 27 08:27:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:27:15.748180 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7302acb0-ebe8-4b31-bc18-32b40d7e918c None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:15.760209 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df172cf2-d307-4cfa-8738-56d6ed55419d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:15.761174 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df172cf2-d307-4cfa-8738-56d6ed55419d None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:15.761357 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df172cf2-d307-4cfa-8738-56d6ed55419d None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:15.761643 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df172cf2-d307-4cfa-8738-56d6ed55419d None admin] PATH_INFO: `/v3/projects/service` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:15.769857 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df172cf2-d307-4cfa-8738-56d6ed55419d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:15.770562 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df172cf2-d307-4cfa-8738-56d6ed55419d None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:15.787579 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application [None req-df172cf2-d307-4cfa-8738-56d6ed55419d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 08:27:15.787579 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:27:15.787579 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:27:15.787579 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:27:15.787579 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:27:15.787579 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:27:15.787579 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:27:15.787579 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:27:15.787579 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:27:15.787579 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:27:15.787579 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:27:15.787579 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:27:15.787579 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 08:27:15.787579 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 08:27:15.787579 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 08:27:15.788462 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 08:27:15.788462 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:27:15.788462 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:27:15.788462 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:27:15.788462 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:27:15.788462 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:27:15.788462 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:27:15.788462 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:27:15.788462 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application with Lock( May 27 08:27:15.788462 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:27:15.788462 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._enter() May 27 08:27:15.788462 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:27:15.788462 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:27:15.788462 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:27:15.788462 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.creator() May 27 08:27:15.788462 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:27:15.788462 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application created_value = creator( May 27 08:27:15.789369 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 08:27:15.789369 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 08:27:15.789369 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 08:27:15.789369 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 08:27:15.789369 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 08:27:15.789369 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 08:27:15.789369 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 08:27:15.789369 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application May 27 08:27:15.789369 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 267/525] 10.222.0.62 () {56 vars in 1111 bytes} [Fri May 27 08:27:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 08:27:15.790398 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df172cf2-d307-4cfa-8738-56d6ed55419d None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:15.859088 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7302acb0-ebe8-4b31-bc18-32b40d7e918c None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:15.902502 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084970c4-dc74-4940-95ec-ec1867289402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:15.903639 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084970c4-dc74-4940-95ec-ec1867289402 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:15.904067 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084970c4-dc74-4940-95ec-ec1867289402 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:15.904475 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084970c4-dc74-4940-95ec-ec1867289402 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:15.912396 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df172cf2-d307-4cfa-8738-56d6ed55419d None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:15.914253 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084970c4-dc74-4940-95ec-ec1867289402 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:15.916685 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084970c4-dc74-4940-95ec-ec1867289402 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:15.934606 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application [None req-084970c4-dc74-4940-95ec-ec1867289402 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 08:27:15.934606 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:27:15.934606 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:27:15.934606 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:27:15.934606 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:27:15.934606 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:27:15.934606 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:27:15.934606 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:27:15.934606 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:27:15.934606 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:27:15.934606 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:27:15.934606 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:27:15.934606 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 08:27:15.934606 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 08:27:15.934606 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 08:27:15.935669 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 08:27:15.935669 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:27:15.935669 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:27:15.935669 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:27:15.935669 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:27:15.935669 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:27:15.935669 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:27:15.935669 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:27:15.935669 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application with Lock( May 27 08:27:15.935669 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:27:15.935669 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._enter() May 27 08:27:15.935669 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:27:15.935669 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:27:15.935669 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:27:15.935669 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.creator() May 27 08:27:15.935669 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:27:15.935669 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application created_value = creator( May 27 08:27:15.936746 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 08:27:15.936746 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 08:27:15.936746 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 08:27:15.936746 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 08:27:15.936746 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 08:27:15.936746 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 08:27:15.936746 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 08:27:15.936746 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application May 27 08:27:15.940783 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 259/526] 10.222.0.62 () {56 vars in 1111 bytes} [Fri May 27 08:27:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 08:27:15.941848 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084970c4-dc74-4940-95ec-ec1867289402 None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:15.953434 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6e4dec-246b-421a-a9a4-a39d97de70e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:15.954315 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6e4dec-246b-421a-a9a4-a39d97de70e0 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:15.955620 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6e4dec-246b-421a-a9a4-a39d97de70e0 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:15.956350 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6e4dec-246b-421a-a9a4-a39d97de70e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:15.957397 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6e4dec-246b-421a-a9a4-a39d97de70e0 None admin] RBAC: Adding query filter params (role.id=d15a26a31e9f4cad8e2c934cf892d50d, scope.project.id=256f4731060449f1b80067e51e8bec00, user.id=839e73c51c5243b68335242a0d695842) {{(pid=87172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:27:15.958007 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6e4dec-246b-421a-a9a4-a39d97de70e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:15.960323 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6e4dec-246b-421a-a9a4-a39d97de70e0 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:15.968432 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 268/527] 10.222.0.62 () {56 vars in 1374 bytes} [Fri May 27 08:27:15 2022] GET /identity/v3/role_assignments?user.id=839e73c51c5243b68335242a0d695842&scope.project.id=256f4731060449f1b80067e51e8bec00&role.id=d15a26a31e9f4cad8e2c934cf892d50d => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:27:15.969788 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6e4dec-246b-421a-a9a4-a39d97de70e0 None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:15.979037 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:16.036863 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:16.064117 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084970c4-dc74-4940-95ec-ec1867289402 None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:16.109346 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d14b930-bd6f-4cf8-8c41-2fdfab0203c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:16.110217 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d14b930-bd6f-4cf8-8c41-2fdfab0203c0 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:16.110573 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d14b930-bd6f-4cf8-8c41-2fdfab0203c0 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:16.111450 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d14b930-bd6f-4cf8-8c41-2fdfab0203c0 None admin] PATH_INFO: `/v3/projects` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:16.112388 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d14b930-bd6f-4cf8-8c41-2fdfab0203c0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:27:16.112869 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d14b930-bd6f-4cf8-8c41-2fdfab0203c0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:16.114507 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d14b930-bd6f-4cf8-8c41-2fdfab0203c0 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:16.129961 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 260/528] 10.222.0.62 () {56 vars in 1148 bytes} [Fri May 27 08:27:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:27:16.137827 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d14b930-bd6f-4cf8-8c41-2fdfab0203c0 None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:16.252499 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:16.265738 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d14b930-bd6f-4cf8-8c41-2fdfab0203c0 None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:16.271413 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6e4dec-246b-421a-a9a4-a39d97de70e0 None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:16.310129 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1140d23f-345f-4a1e-9a4a-556bf4085519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:16.312266 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1140d23f-345f-4a1e-9a4a-556bf4085519 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:16.313221 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1140d23f-345f-4a1e-9a4a-556bf4085519 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:16.314720 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1140d23f-345f-4a1e-9a4a-556bf4085519 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:16.315723 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1140d23f-345f-4a1e-9a4a-556bf4085519 None admin] RBAC: Adding query filter params (role.id=d15a26a31e9f4cad8e2c934cf892d50d, scope.project.id=256f4731060449f1b80067e51e8bec00, user.id=2af5ebcf47654d08881584431b199416) {{(pid=87173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:27:16.316638 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1140d23f-345f-4a1e-9a4a-556bf4085519 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:16.318269 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1140d23f-345f-4a1e-9a4a-556bf4085519 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:16.318397 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92a1977-f3ad-4bf1-a621-ae9a53f5de69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:16.319140 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92a1977-f3ad-4bf1-a621-ae9a53f5de69 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:16.319530 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92a1977-f3ad-4bf1-a621-ae9a53f5de69 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:16.319904 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92a1977-f3ad-4bf1-a621-ae9a53f5de69 None admin] PATH_INFO: `/v3/projects` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:16.320837 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92a1977-f3ad-4bf1-a621-ae9a53f5de69 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:27:16.321355 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92a1977-f3ad-4bf1-a621-ae9a53f5de69 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:16.323009 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92a1977-f3ad-4bf1-a621-ae9a53f5de69 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:16.332696 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 261/529] 10.222.0.62 () {56 vars in 1374 bytes} [Fri May 27 08:27:16 2022] GET /identity/v3/role_assignments?user.id=2af5ebcf47654d08881584431b199416&scope.project.id=256f4731060449f1b80067e51e8bec00&role.id=d15a26a31e9f4cad8e2c934cf892d50d => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:27:16.344237 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 269/530] 10.222.0.62 () {56 vars in 1148 bytes} [Fri May 27 08:27:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 375 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:27:16.351495 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1140d23f-345f-4a1e-9a4a-556bf4085519 None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:16.475271 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1140d23f-345f-4a1e-9a4a-556bf4085519 None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:16.519055 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa78159-45cd-4665-a4fd-4c698ca7ba19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:16.520272 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa78159-45cd-4665-a4fd-4c698ca7ba19 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:16.520272 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa78159-45cd-4665-a4fd-4c698ca7ba19 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:16.520272 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa78159-45cd-4665-a4fd-4c698ca7ba19 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:16.521135 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa78159-45cd-4665-a4fd-4c698ca7ba19 None admin] RBAC: Adding query filter params (role.id=d15a26a31e9f4cad8e2c934cf892d50d, scope.project.id=256f4731060449f1b80067e51e8bec00, user.id=56934ba9afb741679e0573167d6825f5) {{(pid=87173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:27:16.521456 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa78159-45cd-4665-a4fd-4c698ca7ba19 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:16.522962 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa78159-45cd-4665-a4fd-4c698ca7ba19 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:16.529503 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 262/531] 10.222.0.62 () {56 vars in 1374 bytes} [Fri May 27 08:27:16 2022] GET /identity/v3/role_assignments?user.id=56934ba9afb741679e0573167d6825f5&scope.project.id=256f4731060449f1b80067e51e8bec00&role.id=d15a26a31e9f4cad8e2c934cf892d50d => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:27:17.541252 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3c4448-2744-4f53-bb9f-b8507f1ea0c3 None None] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:17.541796 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3c4448-2744-4f53-bb9f-b8507f1ea0c3 None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:17.542065 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3c4448-2744-4f53-bb9f-b8507f1ea0c3 None None] PATH_INFO: `/` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:17.543601 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 270/532] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:27:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:27:17.549637 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d250544-736c-4569-9256-1452f6c90675 None None] REQUEST_METHOD: `POST` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:17.550057 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d250544-736c-4569-9256-1452f6c90675 None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:17.550249 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d250544-736c-4569-9256-1452f6c90675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:17.567429 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.auth.core [None req-7d250544-736c-4569-9256-1452f6c90675 None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:27:17.568661 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.fernet_utils [None req-7d250544-736c-4569-9256-1452f6c90675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:27:17.584243 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:17.647544 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 263/533] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:27:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 08:27:17.672275 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3c4448-2744-4f53-bb9f-b8507f1ea0c3 None None] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:17.778165 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:17.785340 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3c4448-2744-4f53-bb9f-b8507f1ea0c3 None None] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:17.821881 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15153f30-2238-4e1a-9dab-aac29fcd7285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:17.822816 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15153f30-2238-4e1a-9dab-aac29fcd7285 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:17.823131 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15153f30-2238-4e1a-9dab-aac29fcd7285 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:17.823477 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15153f30-2238-4e1a-9dab-aac29fcd7285 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:17.834569 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15153f30-2238-4e1a-9dab-aac29fcd7285 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 08:27:17.842422 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application [None req-15153f30-2238-4e1a-9dab-aac29fcd7285 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 08:27:17.842422 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:27:17.842422 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:27:17.842422 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:27:17.842422 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:27:17.842422 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:27:17.842422 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:27:17.842422 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:27:17.842422 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:27:17.842422 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:27:17.842422 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:27:17.842422 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:27:17.842422 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 08:27:17.842422 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 08:27:17.842422 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 08:27:17.842422 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 08:27:17.843302 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 08:27:17.843302 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 08:27:17.843302 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 08:27:17.843302 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 08:27:17.843302 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:27:17.843302 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:27:17.843302 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:27:17.843302 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:27:17.843302 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:27:17.843302 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:27:17.843302 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:27:17.843302 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application with Lock( May 27 08:27:17.843302 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:27:17.843302 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._enter() May 27 08:27:17.843302 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:27:17.843302 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:27:17.844098 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:27:17.844098 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.creator() May 27 08:27:17.844098 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:27:17.844098 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application created_value = creator( May 27 08:27:17.844098 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 08:27:17.844098 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 08:27:17.844098 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 08:27:17.844098 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 08:27:17.844098 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 08:27:17.844098 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 08:27:17.844098 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 08:27:17.844098 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application May 27 08:27:17.844098 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 271/534] 10.222.0.62 () {56 vars in 1102 bytes} [Fri May 27 08:27:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 08:27:17.851760 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d250544-736c-4569-9256-1452f6c90675 None None] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:17.963669 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d250544-736c-4569-9256-1452f6c90675 None None] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:17.999259 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5a4880-1812-4bdb-b33b-bb02111f246d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:18.000405 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5a4880-1812-4bdb-b33b-bb02111f246d None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:18.000919 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5a4880-1812-4bdb-b33b-bb02111f246d None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:18.001907 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5a4880-1812-4bdb-b33b-bb02111f246d None admin] PATH_INFO: `/v3/roles` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:18.002980 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5a4880-1812-4bdb-b33b-bb02111f246d None admin] RBAC: Adding query filter params (name=service) {{(pid=87173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:27:18.003493 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5a4880-1812-4bdb-b33b-bb02111f246d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:18.005151 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5a4880-1812-4bdb-b33b-bb02111f246d None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:18.014905 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 264/535] 10.222.0.62 () {56 vars in 1103 bytes} [Fri May 27 08:27:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:27:18.021633 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15153f30-2238-4e1a-9dab-aac29fcd7285 None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:18.127507 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15153f30-2238-4e1a-9dab-aac29fcd7285 None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:18.167776 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf449eb1-0dd4-45da-afdb-38a1152506d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:18.168654 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf449eb1-0dd4-45da-afdb-38a1152506d6 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:18.168946 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf449eb1-0dd4-45da-afdb-38a1152506d6 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:18.169223 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf449eb1-0dd4-45da-afdb-38a1152506d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:18.180851 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf449eb1-0dd4-45da-afdb-38a1152506d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:18.182531 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf449eb1-0dd4-45da-afdb-38a1152506d6 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:18.203153 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application [None req-cf449eb1-0dd4-45da-afdb-38a1152506d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 08:27:18.203153 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:27:18.203153 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:27:18.203153 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:27:18.203153 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:27:18.203153 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:27:18.203153 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:27:18.203153 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:27:18.203153 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:27:18.203153 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:27:18.203153 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:27:18.203153 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:27:18.203153 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 08:27:18.203153 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 08:27:18.203153 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 08:27:18.204083 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 08:27:18.204083 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:27:18.204083 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:27:18.204083 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:27:18.204083 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:27:18.204083 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:27:18.204083 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:27:18.204083 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:27:18.204083 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application with Lock( May 27 08:27:18.204083 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:27:18.204083 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._enter() May 27 08:27:18.204083 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:27:18.204083 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:27:18.204083 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:27:18.204083 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.creator() May 27 08:27:18.204083 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:27:18.204083 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application created_value = creator( May 27 08:27:18.205761 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 08:27:18.205761 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 08:27:18.205761 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 08:27:18.205761 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application May 27 08:27:18.205761 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 272/536] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 08:27:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 08:27:18.210747 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5a4880-1812-4bdb-b33b-bb02111f246d None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:18.225557 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:18.325123 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5a4880-1812-4bdb-b33b-bb02111f246d None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:18.362216 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98e03f7-a0e0-48ac-8cbd-59e3998abaf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:18.363218 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98e03f7-a0e0-48ac-8cbd-59e3998abaf8 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:18.363683 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98e03f7-a0e0-48ac-8cbd-59e3998abaf8 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:18.364131 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98e03f7-a0e0-48ac-8cbd-59e3998abaf8 None admin] PATH_INFO: `/v3/domains` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:18.365072 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98e03f7-a0e0-48ac-8cbd-59e3998abaf8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:27:18.365566 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98e03f7-a0e0-48ac-8cbd-59e3998abaf8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:18.367213 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98e03f7-a0e0-48ac-8cbd-59e3998abaf8 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:18.380792 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 265/537] 10.222.0.62 () {56 vars in 1109 bytes} [Fri May 27 08:27:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:27:18.386503 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf449eb1-0dd4-45da-afdb-38a1152506d6 None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:18.401816 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:18.416640 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c0bd3f-a856-45cc-aadf-978a98785c47 None None] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:18.417307 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c0bd3f-a856-45cc-aadf-978a98785c47 None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:18.417793 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c0bd3f-a856-45cc-aadf-978a98785c47 None None] PATH_INFO: `/` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:18.419604 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 266/538] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:27:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 08:27:18.426888 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9679d1fc-8674-4cff-a692-81255a418ae7 None None] REQUEST_METHOD: `POST` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:18.427450 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9679d1fc-8674-4cff-a692-81255a418ae7 None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:18.428000 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9679d1fc-8674-4cff-a692-81255a418ae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:18.446594 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.auth.core [None req-9679d1fc-8674-4cff-a692-81255a418ae7 None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:27:18.448302 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.fernet_utils [None req-9679d1fc-8674-4cff-a692-81255a418ae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:27:18.504725 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf449eb1-0dd4-45da-afdb-38a1152506d6 None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:18.521578 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:18.533324 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 267/539] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:27:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 08:27:18.543216 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442f83cf-2400-4954-b9ad-522ba7569ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:18.544141 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442f83cf-2400-4954-b9ad-522ba7569ce0 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:18.544435 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442f83cf-2400-4954-b9ad-522ba7569ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:18.544775 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442f83cf-2400-4954-b9ad-522ba7569ce0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:18.555943 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442f83cf-2400-4954-b9ad-522ba7569ce0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:18.556970 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9679d1fc-8674-4cff-a692-81255a418ae7 None None] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:18.557481 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442f83cf-2400-4954-b9ad-522ba7569ce0 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:18.572898 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application [None req-442f83cf-2400-4954-b9ad-522ba7569ce0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 27 08:27:18.572898 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:27:18.572898 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:27:18.572898 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:27:18.572898 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:27:18.572898 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:27:18.572898 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:27:18.572898 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:27:18.572898 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:27:18.572898 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:27:18.572898 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:27:18.572898 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:27:18.572898 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 08:27:18.572898 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 08:27:18.572898 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 08:27:18.572898 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 08:27:18.573887 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:27:18.573887 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:27:18.573887 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 08:27:18.573887 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 08:27:18.573887 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 08:27:18.573887 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 08:27:18.573887 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:27:18.573887 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:27:18.573887 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:27:18.573887 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:27:18.573887 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:27:18.573887 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application with Lock( May 27 08:27:18.573887 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:27:18.573887 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._enter() May 27 08:27:18.573887 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:27:18.573887 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:27:18.573887 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:27:18.573887 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.creator() May 27 08:27:18.574841 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:27:18.574841 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application created_value = creator( May 27 08:27:18.574841 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 08:27:18.574841 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 08:27:18.574841 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 08:27:18.574841 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 08:27:18.574841 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 08:27:18.574841 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 08:27:18.574841 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 27 08:27:18.574841 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application May 27 08:27:18.574841 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 273/540] 10.222.0.62 () {56 vars in 1093 bytes} [Fri May 27 08:27:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 08:27:18.579952 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442f83cf-2400-4954-b9ad-522ba7569ce0 None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:18.656052 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:18.674629 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9679d1fc-8674-4cff-a692-81255a418ae7 None None] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:18.695730 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442f83cf-2400-4954-b9ad-522ba7569ce0 None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:18.716528 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2d3444-f144-4a6c-a219-2c9b26682b66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:18.717829 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2d3444-f144-4a6c-a219-2c9b26682b66 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:18.718315 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2d3444-f144-4a6c-a219-2c9b26682b66 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:18.718787 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2d3444-f144-4a6c-a219-2c9b26682b66 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:18.732821 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2d3444-f144-4a6c-a219-2c9b26682b66 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 08:27:18.740575 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb114cb-f4b1-4cde-919d-6730573776ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:18.741286 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb114cb-f4b1-4cde-919d-6730573776ab None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:18.741578 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb114cb-f4b1-4cde-919d-6730573776ab None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:18.741856 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb114cb-f4b1-4cde-919d-6730573776ab None admin] PATH_INFO: `/v3/users` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:18.742636 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application [None req-0b2d3444-f144-4a6c-a219-2c9b26682b66 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 08:27:18.742636 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:27:18.742636 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:27:18.742636 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:27:18.742636 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:27:18.742636 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:27:18.742636 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:27:18.742636 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:27:18.742636 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:27:18.742636 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:27:18.742636 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:27:18.742636 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:27:18.742636 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 08:27:18.742636 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 08:27:18.742636 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 08:27:18.742636 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 08:27:18.743510 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 08:27:18.743510 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 08:27:18.743510 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 08:27:18.743510 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 08:27:18.743510 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:27:18.743510 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:27:18.743510 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:27:18.743510 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:27:18.743510 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:27:18.743510 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:27:18.743510 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:27:18.743510 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application with Lock( May 27 08:27:18.743510 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:27:18.743510 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._enter() May 27 08:27:18.743510 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:27:18.743510 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:27:18.744321 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:27:18.744321 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.creator() May 27 08:27:18.744321 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:27:18.744321 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application created_value = creator( May 27 08:27:18.744321 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 08:27:18.744321 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 08:27:18.744321 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 08:27:18.744321 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 08:27:18.744321 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 08:27:18.744321 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 08:27:18.744321 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 08:27:18.744321 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application May 27 08:27:18.744960 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb114cb-f4b1-4cde-919d-6730573776ab None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:27:18.744960 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb114cb-f4b1-4cde-919d-6730573776ab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:18.744960 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb114cb-f4b1-4cde-919d-6730573776ab None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:18.750247 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 268/541] 10.222.0.62 () {56 vars in 1102 bytes} [Fri May 27 08:27:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 08:27:18.750247 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3e4dcb-dd6d-40d5-852a-f8471fcbf3a9 None None] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:18.750247 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3e4dcb-dd6d-40d5-852a-f8471fcbf3a9 None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:18.750247 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3e4dcb-dd6d-40d5-852a-f8471fcbf3a9 None None] PATH_INFO: `/` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:18.753098 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 269/542] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:27:18 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:27:18.754887 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3e4dcb-dd6d-40d5-852a-f8471fcbf3a9 None None] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:18.764897 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 274/543] 10.222.0.62 () {56 vars in 1133 bytes} [Fri May 27 08:27:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 08:27:18.766582 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feb8ea6-132d-4831-95dd-36427f8943fa None None] REQUEST_METHOD: `POST` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:18.767678 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feb8ea6-132d-4831-95dd-36427f8943fa None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:18.768164 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feb8ea6-132d-4831-95dd-36427f8943fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:18.785777 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.auth.core [None req-8feb8ea6-132d-4831-95dd-36427f8943fa None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:27:18.787248 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.fernet_utils [None req-8feb8ea6-132d-4831-95dd-36427f8943fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:27:18.822801 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:18.878122 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 275/544] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:27:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 08:27:18.880845 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8feb8ea6-132d-4831-95dd-36427f8943fa None None] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:18.898811 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3e4dcb-dd6d-40d5-852a-f8471fcbf3a9 None None] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:18.940136 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b9e371-e385-4116-b068-e5bc7b54a988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:18.940760 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b9e371-e385-4116-b068-e5bc7b54a988 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:18.941048 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b9e371-e385-4116-b068-e5bc7b54a988 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:18.941328 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b9e371-e385-4116-b068-e5bc7b54a988 None admin] PATH_INFO: `/v3/roles` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:18.942082 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b9e371-e385-4116-b068-e5bc7b54a988 None admin] RBAC: Adding query filter params (name=service) {{(pid=87173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:27:18.942388 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b9e371-e385-4116-b068-e5bc7b54a988 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:18.943787 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b9e371-e385-4116-b068-e5bc7b54a988 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:18.946338 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:18.952513 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 270/545] 10.222.0.62 () {56 vars in 1103 bytes} [Fri May 27 08:27:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:27:18.953338 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b9e371-e385-4116-b068-e5bc7b54a988 None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:18.993297 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8feb8ea6-132d-4831-95dd-36427f8943fa None None] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:19.028276 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89809566-b3f7-4ace-bfbe-6359a0a0e0f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:19.029105 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89809566-b3f7-4ace-bfbe-6359a0a0e0f9 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:19.029390 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89809566-b3f7-4ace-bfbe-6359a0a0e0f9 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:19.029672 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89809566-b3f7-4ace-bfbe-6359a0a0e0f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:19.042469 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89809566-b3f7-4ace-bfbe-6359a0a0e0f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:19.044479 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89809566-b3f7-4ace-bfbe-6359a0a0e0f9 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:19.059043 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b9e371-e385-4116-b068-e5bc7b54a988 None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:19.062353 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application [None req-89809566-b3f7-4ace-bfbe-6359a0a0e0f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 08:27:19.062353 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:27:19.062353 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:27:19.062353 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:27:19.062353 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:27:19.062353 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:27:19.062353 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:27:19.062353 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:27:19.062353 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:27:19.062353 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:27:19.062353 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:27:19.062353 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:27:19.062353 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 08:27:19.062353 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 08:27:19.062353 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 08:27:19.063284 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 08:27:19.063284 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:27:19.063284 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:27:19.063284 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:27:19.063284 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:27:19.063284 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:27:19.063284 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:27:19.063284 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:27:19.063284 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application with Lock( May 27 08:27:19.063284 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:27:19.063284 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._enter() May 27 08:27:19.063284 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:27:19.063284 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:27:19.063284 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:27:19.063284 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.creator() May 27 08:27:19.063284 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:27:19.063284 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application created_value = creator( May 27 08:27:19.064123 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 08:27:19.064123 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 08:27:19.064123 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 08:27:19.064123 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application May 27 08:27:19.064123 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 276/546] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 08:27:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 08:27:19.064899 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9be5f3-567f-480c-99c6-ad9d985abd86 None None] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:19.065185 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9be5f3-567f-480c-99c6-ad9d985abd86 None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:19.065508 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9be5f3-567f-480c-99c6-ad9d985abd86 None None] PATH_INFO: `/` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:19.066777 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 277/547] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:27:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:27:19.067460 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9be5f3-567f-480c-99c6-ad9d985abd86 None None] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:19.087124 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:19.100167 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3508870b-f3f7-47fe-8234-8eb0bab36568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:19.100992 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3508870b-f3f7-47fe-8234-8eb0bab36568 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:19.101272 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3508870b-f3f7-47fe-8234-8eb0bab36568 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:19.101607 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3508870b-f3f7-47fe-8234-8eb0bab36568 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:19.112292 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3508870b-f3f7-47fe-8234-8eb0bab36568 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 08:27:19.120014 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application [None req-3508870b-f3f7-47fe-8234-8eb0bab36568 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 08:27:19.120014 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:27:19.120014 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:27:19.120014 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:27:19.120014 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:27:19.120014 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:27:19.120014 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:27:19.120014 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:27:19.120014 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:27:19.120014 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:27:19.120014 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:27:19.120014 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:27:19.120014 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 08:27:19.120014 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 08:27:19.120014 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 08:27:19.120014 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 08:27:19.121032 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 08:27:19.121032 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 08:27:19.121032 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 08:27:19.121032 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 08:27:19.121032 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:27:19.121032 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:27:19.121032 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:27:19.121032 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:27:19.121032 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:27:19.121032 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:27:19.121032 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:27:19.121032 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application with Lock( May 27 08:27:19.121032 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:27:19.121032 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._enter() May 27 08:27:19.121032 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:27:19.121032 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:27:19.121990 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:27:19.121990 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.creator() May 27 08:27:19.121990 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:27:19.121990 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application created_value = creator( May 27 08:27:19.121990 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 08:27:19.121990 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 08:27:19.121990 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 08:27:19.121990 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 08:27:19.121990 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 08:27:19.121990 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 08:27:19.121990 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 08:27:19.121990 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application May 27 08:27:19.121990 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 271/548] 10.222.0.62 () {56 vars in 1102 bytes} [Fri May 27 08:27:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 08:27:19.121990 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3508870b-f3f7-47fe-8234-8eb0bab36568 None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:19.173590 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9be5f3-567f-480c-99c6-ad9d985abd86 None None] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:19.182759 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:19.210144 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3286ab28-70aa-43d1-b2eb-f019e6bdc411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:19.210980 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3286ab28-70aa-43d1-b2eb-f019e6bdc411 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:19.211278 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3286ab28-70aa-43d1-b2eb-f019e6bdc411 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:19.211557 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3286ab28-70aa-43d1-b2eb-f019e6bdc411 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:19.222534 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3286ab28-70aa-43d1-b2eb-f019e6bdc411 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:19.224030 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3286ab28-70aa-43d1-b2eb-f019e6bdc411 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:19.227336 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3508870b-f3f7-47fe-8234-8eb0bab36568 None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:19.241693 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application [None req-3286ab28-70aa-43d1-b2eb-f019e6bdc411 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 08:27:19.241693 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:27:19.241693 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:27:19.241693 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:27:19.241693 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:27:19.241693 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:27:19.241693 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:27:19.241693 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:27:19.241693 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:27:19.241693 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:27:19.241693 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:27:19.241693 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:27:19.241693 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 08:27:19.241693 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 08:27:19.241693 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 08:27:19.242590 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 08:27:19.242590 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:27:19.242590 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:27:19.242590 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:27:19.242590 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:27:19.242590 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:27:19.242590 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:27:19.242590 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:27:19.242590 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application with Lock( May 27 08:27:19.242590 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:27:19.242590 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._enter() May 27 08:27:19.242590 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:27:19.242590 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:27:19.242590 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:27:19.242590 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.creator() May 27 08:27:19.242590 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:27:19.242590 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application created_value = creator( May 27 08:27:19.243433 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 08:27:19.243433 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 08:27:19.243433 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 08:27:19.243433 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application May 27 08:27:19.243433 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 278/549] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 08:27:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 08:27:19.244090 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4222b9-956d-4f15-887b-7d42d07261f7 None None] REQUEST_METHOD: `POST` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:19.244373 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4222b9-956d-4f15-887b-7d42d07261f7 None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:19.244672 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4222b9-956d-4f15-887b-7d42d07261f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:19.262367 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.auth.core [None req-2f4222b9-956d-4f15-887b-7d42d07261f7 None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:27:19.263570 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.fernet_utils [None req-2f4222b9-956d-4f15-887b-7d42d07261f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:27:19.265753 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133f7c65-a997-4128-a80a-586e3a35c73a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:19.266418 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133f7c65-a997-4128-a80a-586e3a35c73a None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:19.266732 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133f7c65-a997-4128-a80a-586e3a35c73a None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:19.267571 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133f7c65-a997-4128-a80a-586e3a35c73a None admin] PATH_INFO: `/v3/domains` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:19.268308 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133f7c65-a997-4128-a80a-586e3a35c73a None admin] RBAC: Adding query filter params (name=Default) {{(pid=87173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:27:19.268651 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133f7c65-a997-4128-a80a-586e3a35c73a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:19.270038 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133f7c65-a997-4128-a80a-586e3a35c73a None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:19.282344 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 272/550] 10.222.0.62 () {56 vars in 1109 bytes} [Fri May 27 08:27:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:27:19.283347 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133f7c65-a997-4128-a80a-586e3a35c73a None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:19.328718 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:19.335453 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 279/551] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:27:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 08:27:19.336297 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4222b9-956d-4f15-887b-7d42d07261f7 None None] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:19.401959 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133f7c65-a997-4128-a80a-586e3a35c73a None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:19.428423 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:19.436412 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbae1d3-37b2-4e2b-8915-981f0dae27e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:19.437112 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbae1d3-37b2-4e2b-8915-981f0dae27e9 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:19.437397 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbae1d3-37b2-4e2b-8915-981f0dae27e9 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:19.437680 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbae1d3-37b2-4e2b-8915-981f0dae27e9 None admin] PATH_INFO: `/v3/roles` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:19.438422 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbae1d3-37b2-4e2b-8915-981f0dae27e9 None admin] RBAC: Adding query filter params (name=service) {{(pid=87173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:27:19.439256 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbae1d3-37b2-4e2b-8915-981f0dae27e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:19.439501 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4222b9-956d-4f15-887b-7d42d07261f7 None None] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:19.440834 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbae1d3-37b2-4e2b-8915-981f0dae27e9 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:19.448982 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 273/552] 10.222.0.62 () {56 vars in 1103 bytes} [Fri May 27 08:27:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:27:19.449577 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbae1d3-37b2-4e2b-8915-981f0dae27e9 None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:19.480360 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110707e7-79ba-4939-be3b-618decde9f1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:19.480973 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110707e7-79ba-4939-be3b-618decde9f1b None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:19.481267 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110707e7-79ba-4939-be3b-618decde9f1b None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:19.481549 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110707e7-79ba-4939-be3b-618decde9f1b None admin] PATH_INFO: `/v3/domains` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:19.482276 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110707e7-79ba-4939-be3b-618decde9f1b None admin] RBAC: Adding query filter params (name=Default) {{(pid=87172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:27:19.482586 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110707e7-79ba-4939-be3b-618decde9f1b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:19.483972 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110707e7-79ba-4939-be3b-618decde9f1b None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:19.495719 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 280/553] 10.222.0.62 () {56 vars in 1109 bytes} [Fri May 27 08:27:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:27:19.496531 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110707e7-79ba-4939-be3b-618decde9f1b None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:19.551888 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbae1d3-37b2-4e2b-8915-981f0dae27e9 None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:19.554206 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:19.587898 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db868d67-f6ff-4a91-924d-53b22a568c5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:19.588755 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db868d67-f6ff-4a91-924d-53b22a568c5e None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:19.589039 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db868d67-f6ff-4a91-924d-53b22a568c5e None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:19.589316 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db868d67-f6ff-4a91-924d-53b22a568c5e None admin] PATH_INFO: `/v3/projects/service` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:19.596677 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db868d67-f6ff-4a91-924d-53b22a568c5e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:19.597661 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110707e7-79ba-4939-be3b-618decde9f1b None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:19.598143 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db868d67-f6ff-4a91-924d-53b22a568c5e None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:19.613185 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application [None req-db868d67-f6ff-4a91-924d-53b22a568c5e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 08:27:19.613185 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:27:19.613185 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:27:19.613185 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:27:19.613185 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:27:19.613185 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:27:19.613185 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:27:19.613185 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:27:19.613185 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:27:19.613185 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:27:19.613185 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:27:19.613185 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:27:19.613185 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 08:27:19.613185 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 08:27:19.613185 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 08:27:19.614131 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 08:27:19.614131 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:27:19.614131 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:27:19.614131 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:27:19.614131 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:27:19.614131 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:27:19.614131 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:27:19.614131 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:27:19.614131 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application with Lock( May 27 08:27:19.614131 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:27:19.614131 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._enter() May 27 08:27:19.614131 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:27:19.614131 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:27:19.614131 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:27:19.614131 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.creator() May 27 08:27:19.614131 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:27:19.614131 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application created_value = creator( May 27 08:27:19.615004 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 08:27:19.615004 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 08:27:19.615004 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 08:27:19.615004 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 08:27:19.615004 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 08:27:19.615004 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 08:27:19.615004 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 08:27:19.615004 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application May 27 08:27:19.615004 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 274/554] 10.222.0.62 () {56 vars in 1111 bytes} [Fri May 27 08:27:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 08:27:19.615493 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db868d67-f6ff-4a91-924d-53b22a568c5e None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:19.636180 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f3f041-73a0-4f6b-81f0-1a68227f8463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:19.637011 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f3f041-73a0-4f6b-81f0-1a68227f8463 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:19.637300 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f3f041-73a0-4f6b-81f0-1a68227f8463 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:19.637580 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f3f041-73a0-4f6b-81f0-1a68227f8463 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:19.649142 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f3f041-73a0-4f6b-81f0-1a68227f8463 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 08:27:19.656925 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application [None req-60f3f041-73a0-4f6b-81f0-1a68227f8463 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 08:27:19.656925 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:27:19.656925 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:27:19.656925 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:27:19.656925 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:27:19.656925 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:27:19.656925 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:27:19.656925 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:27:19.656925 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:27:19.656925 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:27:19.656925 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:27:19.656925 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:27:19.656925 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 08:27:19.656925 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 08:27:19.656925 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 08:27:19.656925 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 08:27:19.658009 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 08:27:19.658009 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 08:27:19.658009 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 08:27:19.658009 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 08:27:19.658009 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:27:19.658009 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:27:19.658009 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:27:19.658009 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:27:19.658009 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:27:19.658009 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:27:19.658009 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:27:19.658009 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application with Lock( May 27 08:27:19.658009 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:27:19.658009 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._enter() May 27 08:27:19.658009 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:27:19.658009 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:27:19.658816 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:27:19.658816 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.creator() May 27 08:27:19.658816 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:27:19.658816 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application created_value = creator( May 27 08:27:19.658816 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 08:27:19.658816 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 08:27:19.658816 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 08:27:19.658816 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 08:27:19.658816 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 08:27:19.658816 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 08:27:19.658816 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 08:27:19.658816 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application May 27 08:27:19.658816 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 281/555] 10.222.0.62 () {56 vars in 1102 bytes} [Fri May 27 08:27:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 08:27:19.660257 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f3f041-73a0-4f6b-81f0-1a68227f8463 None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:19.676269 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:19.722762 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db868d67-f6ff-4a91-924d-53b22a568c5e None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:19.758033 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112896b2-aa58-4349-8952-3a8389feda70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:19.758741 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112896b2-aa58-4349-8952-3a8389feda70 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:19.759024 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112896b2-aa58-4349-8952-3a8389feda70 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:19.759300 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112896b2-aa58-4349-8952-3a8389feda70 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:19.765803 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f3f041-73a0-4f6b-81f0-1a68227f8463 None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:19.769842 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112896b2-aa58-4349-8952-3a8389feda70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:19.771323 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112896b2-aa58-4349-8952-3a8389feda70 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:19.791528 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application [None req-112896b2-aa58-4349-8952-3a8389feda70 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 08:27:19.791528 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:27:19.791528 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:27:19.791528 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:27:19.791528 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:27:19.791528 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:27:19.791528 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:27:19.791528 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:27:19.791528 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:27:19.791528 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:27:19.791528 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:27:19.791528 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:27:19.791528 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 08:27:19.791528 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 08:27:19.791528 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 08:27:19.792540 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 08:27:19.792540 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:27:19.792540 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:27:19.792540 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:27:19.792540 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:27:19.792540 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:27:19.792540 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:27:19.792540 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:27:19.792540 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application with Lock( May 27 08:27:19.792540 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:27:19.792540 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._enter() May 27 08:27:19.792540 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:27:19.792540 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:27:19.792540 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:27:19.792540 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.creator() May 27 08:27:19.792540 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:27:19.792540 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application created_value = creator( May 27 08:27:19.793990 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 08:27:19.793990 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 08:27:19.793990 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 08:27:19.793990 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application May 27 08:27:19.793990 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 275/556] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 08:27:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 08:27:19.793990 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112896b2-aa58-4349-8952-3a8389feda70 None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:19.808336 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f057fab2-6234-4fbd-b3bb-0baa4a860bc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:19.809163 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f057fab2-6234-4fbd-b3bb-0baa4a860bc0 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:19.809452 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f057fab2-6234-4fbd-b3bb-0baa4a860bc0 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:19.809730 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f057fab2-6234-4fbd-b3bb-0baa4a860bc0 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:19.811528 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:19.818224 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f057fab2-6234-4fbd-b3bb-0baa4a860bc0 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:19.819747 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f057fab2-6234-4fbd-b3bb-0baa4a860bc0 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:19.835386 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application [None req-f057fab2-6234-4fbd-b3bb-0baa4a860bc0 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 27 08:27:19.835386 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:27:19.835386 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:27:19.835386 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:27:19.835386 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:27:19.835386 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:27:19.835386 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:27:19.835386 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:27:19.835386 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:27:19.835386 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:27:19.835386 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:27:19.835386 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:27:19.835386 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 08:27:19.835386 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 08:27:19.835386 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 08:27:19.835386 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 08:27:19.836340 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:27:19.836340 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:27:19.836340 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 08:27:19.836340 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 08:27:19.836340 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 08:27:19.836340 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 08:27:19.836340 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:27:19.836340 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:27:19.836340 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:27:19.836340 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:27:19.836340 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:27:19.836340 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application with Lock( May 27 08:27:19.836340 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:27:19.836340 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._enter() May 27 08:27:19.836340 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:27:19.836340 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:27:19.836340 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:27:19.836340 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.creator() May 27 08:27:19.838220 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:27:19.838220 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application created_value = creator( May 27 08:27:19.838220 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 08:27:19.838220 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 08:27:19.838220 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 08:27:19.838220 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 08:27:19.838220 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 08:27:19.838220 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 08:27:19.838220 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 27 08:27:19.838220 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application May 27 08:27:19.838220 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 282/557] 10.222.0.62 () {56 vars in 1099 bytes} [Fri May 27 08:27:19 2022] GET /identity/v3/users/cinder => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 08:27:19.838220 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f057fab2-6234-4fbd-b3bb-0baa4a860bc0 None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:19.903197 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112896b2-aa58-4349-8952-3a8389feda70 None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:19.913582 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:19.937931 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf80f96-c528-49bf-b644-c18375bf9e53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:19.938647 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf80f96-c528-49bf-b644-c18375bf9e53 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:19.938944 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf80f96-c528-49bf-b644-c18375bf9e53 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:19.939288 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf80f96-c528-49bf-b644-c18375bf9e53 None admin] PATH_INFO: `/v3/projects` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:19.940020 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf80f96-c528-49bf-b644-c18375bf9e53 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:27:19.940326 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf80f96-c528-49bf-b644-c18375bf9e53 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:19.941809 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf80f96-c528-49bf-b644-c18375bf9e53 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:19.944228 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f057fab2-6234-4fbd-b3bb-0baa4a860bc0 None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:19.953779 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 276/558] 10.222.0.62 () {56 vars in 1148 bytes} [Fri May 27 08:27:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:27:19.955178 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf80f96-c528-49bf-b644-c18375bf9e53 None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:19.978787 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8e4445-a379-4458-8d35-eae4ab34a7a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:19.979511 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8e4445-a379-4458-8d35-eae4ab34a7a4 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:19.979793 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8e4445-a379-4458-8d35-eae4ab34a7a4 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:19.980093 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8e4445-a379-4458-8d35-eae4ab34a7a4 None admin] PATH_INFO: `/v3/roles` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:19.980870 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8e4445-a379-4458-8d35-eae4ab34a7a4 None admin] RBAC: Adding query filter params (name=service) {{(pid=87172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:27:19.981171 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8e4445-a379-4458-8d35-eae4ab34a7a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:19.982536 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8e4445-a379-4458-8d35-eae4ab34a7a4 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:19.990481 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 283/559] 10.222.0.62 () {56 vars in 1103 bytes} [Fri May 27 08:27:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:27:19.991294 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8e4445-a379-4458-8d35-eae4ab34a7a4 None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:20.052799 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:20.076422 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf80f96-c528-49bf-b644-c18375bf9e53 None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:20.095887 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8e4445-a379-4458-8d35-eae4ab34a7a4 None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:20.111323 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588d9b8c-c289-4b14-8833-80ffb99ecc3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:20.112079 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588d9b8c-c289-4b14-8833-80ffb99ecc3a None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:20.112368 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588d9b8c-c289-4b14-8833-80ffb99ecc3a None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:20.112668 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588d9b8c-c289-4b14-8833-80ffb99ecc3a None admin] PATH_INFO: `/v3/domains` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:20.113395 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588d9b8c-c289-4b14-8833-80ffb99ecc3a None admin] RBAC: Adding query filter params (name=Default) {{(pid=87173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:27:20.113698 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588d9b8c-c289-4b14-8833-80ffb99ecc3a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:20.115086 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588d9b8c-c289-4b14-8833-80ffb99ecc3a None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:20.126730 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 277/560] 10.222.0.62 () {56 vars in 1109 bytes} [Fri May 27 08:27:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:27:20.127492 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588d9b8c-c289-4b14-8833-80ffb99ecc3a None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:20.131132 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:20.136393 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd8f4f4-096e-4432-aacd-555b84328f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:20.137099 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd8f4f4-096e-4432-aacd-555b84328f68 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:20.137378 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd8f4f4-096e-4432-aacd-555b84328f68 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:20.137653 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd8f4f4-096e-4432-aacd-555b84328f68 None admin] PATH_INFO: `/v3/users` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:20.138494 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd8f4f4-096e-4432-aacd-555b84328f68 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:27:20.138799 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd8f4f4-096e-4432-aacd-555b84328f68 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:20.140233 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd8f4f4-096e-4432-aacd-555b84328f68 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:20.158233 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 284/561] 10.222.0.62 () {56 vars in 1137 bytes} [Fri May 27 08:27:19 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:27:20.159036 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd8f4f4-096e-4432-aacd-555b84328f68 None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:20.229749 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588d9b8c-c289-4b14-8833-80ffb99ecc3a None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:20.259840 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd8f4f4-096e-4432-aacd-555b84328f68 None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:20.264642 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571f465d-d427-4ce4-a6c3-13fafdc0ed2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:20.265530 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571f465d-d427-4ce4-a6c3-13fafdc0ed2a None admin] REQUEST_METHOD: `PUT` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:20.265817 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571f465d-d427-4ce4-a6c3-13fafdc0ed2a None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:20.266098 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571f465d-d427-4ce4-a6c3-13fafdc0ed2a None admin] PATH_INFO: `/v3/projects/256f4731060449f1b80067e51e8bec00/users/3a09bdc2dbac4f9abe450ff121e7dce8/roles/d15a26a31e9f4cad8e2c934cf892d50d` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:20.269787 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:20.281686 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571f465d-d427-4ce4-a6c3-13fafdc0ed2a None admin] RBAC: Authorizing `identity:create_grant(project_id=256f4731060449f1b80067e51e8bec00, user_id=3a09bdc2dbac4f9abe450ff121e7dce8, role_id=d15a26a31e9f4cad8e2c934cf892d50d)` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:20.283701 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571f465d-d427-4ce4-a6c3-13fafdc0ed2a None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:20.295566 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd97eac1-b4a1-4e4e-b9ac-7a4a4a59fb3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:20.296357 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd97eac1-b4a1-4e4e-b9ac-7a4a4a59fb3d None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:20.296673 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd97eac1-b4a1-4e4e-b9ac-7a4a4a59fb3d None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:20.296950 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd97eac1-b4a1-4e4e-b9ac-7a4a4a59fb3d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:20.297572 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 278/562] 10.222.0.62 () {58 vars in 1439 bytes} [Fri May 27 08:27:20 2022] PUT /identity/v3/projects/256f4731060449f1b80067e51e8bec00/users/3a09bdc2dbac4f9abe450ff121e7dce8/roles/d15a26a31e9f4cad8e2c934cf892d50d => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 08:27:20.298939 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571f465d-d427-4ce4-a6c3-13fafdc0ed2a None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:20.314808 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd97eac1-b4a1-4e4e-b9ac-7a4a4a59fb3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:20.316404 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd97eac1-b4a1-4e4e-b9ac-7a4a4a59fb3d None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:20.336893 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application [None req-dd97eac1-b4a1-4e4e-b9ac-7a4a4a59fb3d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 08:27:20.336893 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:27:20.336893 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:27:20.336893 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:27:20.336893 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:27:20.336893 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:27:20.336893 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:27:20.336893 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:27:20.336893 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:27:20.336893 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:27:20.336893 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:27:20.336893 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:27:20.336893 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 08:27:20.336893 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 08:27:20.336893 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 08:27:20.338030 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 08:27:20.338030 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:27:20.338030 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:27:20.338030 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:27:20.338030 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:27:20.338030 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:27:20.338030 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:27:20.338030 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:27:20.338030 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application with Lock( May 27 08:27:20.338030 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:27:20.338030 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._enter() May 27 08:27:20.338030 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:27:20.338030 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:27:20.338030 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:27:20.338030 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.creator() May 27 08:27:20.338030 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:27:20.338030 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application created_value = creator( May 27 08:27:20.339180 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 08:27:20.339180 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 08:27:20.339180 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 08:27:20.339180 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application May 27 08:27:20.339899 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 285/563] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 08:27:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 08:27:20.340805 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd97eac1-b4a1-4e4e-b9ac-7a4a4a59fb3d None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:20.396864 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:20.449031 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571f465d-d427-4ce4-a6c3-13fafdc0ed2a None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:20.468127 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd97eac1-b4a1-4e4e-b9ac-7a4a4a59fb3d None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:20.492040 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cff4770-abea-4fd1-8ac1-53d791e05615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:20.493120 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cff4770-abea-4fd1-8ac1-53d791e05615 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:20.493509 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cff4770-abea-4fd1-8ac1-53d791e05615 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:20.493889 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cff4770-abea-4fd1-8ac1-53d791e05615 None admin] PATH_INFO: `/v3/users/glance` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:20.503151 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cff4770-abea-4fd1-8ac1-53d791e05615 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:20.504839 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cff4770-abea-4fd1-8ac1-53d791e05615 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:20.515458 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed91504b-4821-4e32-8831-bc20d2f6038a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:20.516327 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed91504b-4821-4e32-8831-bc20d2f6038a None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:20.516550 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed91504b-4821-4e32-8831-bc20d2f6038a None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:20.517461 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed91504b-4821-4e32-8831-bc20d2f6038a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:20.522425 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application [None req-0cff4770-abea-4fd1-8ac1-53d791e05615 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 27 08:27:20.522425 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:27:20.522425 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:27:20.522425 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:27:20.522425 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:27:20.522425 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:27:20.522425 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:27:20.522425 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:27:20.522425 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:27:20.522425 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:27:20.522425 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:27:20.522425 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:27:20.522425 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 08:27:20.522425 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 08:27:20.522425 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 08:27:20.522425 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 08:27:20.523541 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:27:20.523541 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:27:20.523541 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 08:27:20.523541 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 08:27:20.523541 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 08:27:20.523541 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 08:27:20.523541 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:27:20.523541 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:27:20.523541 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:27:20.523541 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:27:20.523541 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:27:20.523541 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application with Lock( May 27 08:27:20.523541 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:27:20.523541 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._enter() May 27 08:27:20.523541 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:27:20.523541 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:27:20.523541 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:27:20.523541 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.creator() May 27 08:27:20.524696 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:27:20.524696 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application created_value = creator( May 27 08:27:20.524696 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 08:27:20.524696 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 08:27:20.524696 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 08:27:20.524696 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 08:27:20.524696 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 08:27:20.524696 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 08:27:20.524696 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 27 08:27:20.524696 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application May 27 08:27:20.525429 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 279/564] 10.222.0.62 () {56 vars in 1099 bytes} [Fri May 27 08:27:20 2022] GET /identity/v3/users/glance => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 08:27:20.525743 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cff4770-abea-4fd1-8ac1-53d791e05615 None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:20.529108 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed91504b-4821-4e32-8831-bc20d2f6038a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:20.530746 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed91504b-4821-4e32-8831-bc20d2f6038a None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:20.551823 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application [None req-ed91504b-4821-4e32-8831-bc20d2f6038a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 08:27:20.551823 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:27:20.551823 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:27:20.551823 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:27:20.551823 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:27:20.551823 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:27:20.551823 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:27:20.551823 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:27:20.551823 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:27:20.551823 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:27:20.551823 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:27:20.551823 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:27:20.551823 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 08:27:20.551823 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 08:27:20.551823 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 08:27:20.552954 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 08:27:20.552954 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:27:20.552954 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:27:20.552954 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:27:20.552954 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:27:20.552954 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:27:20.552954 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:27:20.552954 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:27:20.552954 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application with Lock( May 27 08:27:20.552954 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:27:20.552954 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._enter() May 27 08:27:20.552954 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:27:20.552954 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:27:20.552954 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:27:20.552954 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.creator() May 27 08:27:20.552954 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:27:20.552954 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application created_value = creator( May 27 08:27:20.553914 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 08:27:20.553914 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 08:27:20.553914 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 08:27:20.553914 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application May 27 08:27:20.553914 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 286/565] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 08:27:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 08:27:20.554189 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed91504b-4821-4e32-8831-bc20d2f6038a None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:20.580428 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:20.640633 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cff4770-abea-4fd1-8ac1-53d791e05615 None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:20.665338 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:20.676253 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed91504b-4821-4e32-8831-bc20d2f6038a None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:20.681874 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30020668-94c0-42c3-b308-57645a526732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:20.682552 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30020668-94c0-42c3-b308-57645a526732 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:20.682832 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30020668-94c0-42c3-b308-57645a526732 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:20.683110 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30020668-94c0-42c3-b308-57645a526732 None admin] PATH_INFO: `/v3/domains` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:20.683880 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30020668-94c0-42c3-b308-57645a526732 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:27:20.684190 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30020668-94c0-42c3-b308-57645a526732 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:20.686091 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30020668-94c0-42c3-b308-57645a526732 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:20.705732 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 280/566] 10.222.0.62 () {56 vars in 1109 bytes} [Fri May 27 08:27:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:27:20.705732 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30020668-94c0-42c3-b308-57645a526732 None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:20.718565 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce98ba7-41ba-4c30-b101-7afe41bd2942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:20.719334 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce98ba7-41ba-4c30-b101-7afe41bd2942 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:20.719627 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce98ba7-41ba-4c30-b101-7afe41bd2942 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:20.720018 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce98ba7-41ba-4c30-b101-7afe41bd2942 None admin] PATH_INFO: `/v3/users` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:20.720909 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce98ba7-41ba-4c30-b101-7afe41bd2942 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:27:20.721235 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce98ba7-41ba-4c30-b101-7afe41bd2942 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:20.722707 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce98ba7-41ba-4c30-b101-7afe41bd2942 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:20.741129 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 287/567] 10.222.0.62 () {56 vars in 1137 bytes} [Fri May 27 08:27:20 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:27:20.742839 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce98ba7-41ba-4c30-b101-7afe41bd2942 None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:20.830760 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30020668-94c0-42c3-b308-57645a526732 None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:20.841402 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:20.879964 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c6eac3-c997-497d-9143-f12a50d8c8c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:20.880280 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce98ba7-41ba-4c30-b101-7afe41bd2942 None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:20.881620 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c6eac3-c997-497d-9143-f12a50d8c8c3 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:20.882527 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c6eac3-c997-497d-9143-f12a50d8c8c3 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:20.883317 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c6eac3-c997-497d-9143-f12a50d8c8c3 None admin] PATH_INFO: `/v3/domains` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:20.884709 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c6eac3-c997-497d-9143-f12a50d8c8c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:27:20.885597 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c6eac3-c997-497d-9143-f12a50d8c8c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:20.887382 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c6eac3-c997-497d-9143-f12a50d8c8c3 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:20.908134 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 281/568] 10.222.0.62 () {56 vars in 1109 bytes} [Fri May 27 08:27:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:27:20.909206 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c6eac3-c997-497d-9143-f12a50d8c8c3 None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:20.927147 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230fa9fd-b938-4586-9105-482a0150a2e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:20.928381 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230fa9fd-b938-4586-9105-482a0150a2e7 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:20.928973 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230fa9fd-b938-4586-9105-482a0150a2e7 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:20.929257 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230fa9fd-b938-4586-9105-482a0150a2e7 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:20.938842 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230fa9fd-b938-4586-9105-482a0150a2e7 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:20.940636 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230fa9fd-b938-4586-9105-482a0150a2e7 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:20.959742 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application [None req-230fa9fd-b938-4586-9105-482a0150a2e7 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 27 08:27:20.959742 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:27:20.959742 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:27:20.959742 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:27:20.959742 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:27:20.959742 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:27:20.959742 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:27:20.959742 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:27:20.959742 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:27:20.959742 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:27:20.959742 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:27:20.959742 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:27:20.959742 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 08:27:20.959742 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 08:27:20.959742 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 08:27:20.959742 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 08:27:20.960950 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:27:20.960950 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:27:20.960950 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 08:27:20.960950 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 08:27:20.960950 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 08:27:20.960950 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 08:27:20.960950 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:27:20.960950 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:27:20.960950 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:27:20.960950 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:27:20.960950 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:27:20.960950 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application with Lock( May 27 08:27:20.960950 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:27:20.960950 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._enter() May 27 08:27:20.960950 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:27:20.960950 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:27:20.960950 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:27:20.960950 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.creator() May 27 08:27:20.961988 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:27:20.961988 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application created_value = creator( May 27 08:27:20.961988 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 08:27:20.961988 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 08:27:20.961988 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 08:27:20.961988 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 08:27:20.961988 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 08:27:20.961988 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 08:27:20.961988 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 27 08:27:20.961988 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application May 27 08:27:20.966047 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 288/569] 10.222.0.62 () {56 vars in 1102 bytes} [Fri May 27 08:27:20 2022] GET /identity/v3/users/neutron => generated 85 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 08:27:20.967188 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230fa9fd-b938-4586-9105-482a0150a2e7 None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:20.986391 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:21.040268 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c6eac3-c997-497d-9143-f12a50d8c8c3 None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:21.088891 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493e251b-34fd-4b78-91a5-47c1204ea77a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:21.089609 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493e251b-34fd-4b78-91a5-47c1204ea77a None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:21.089895 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493e251b-34fd-4b78-91a5-47c1204ea77a None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:21.090182 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493e251b-34fd-4b78-91a5-47c1204ea77a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:21.093734 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230fa9fd-b938-4586-9105-482a0150a2e7 None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:21.105933 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493e251b-34fd-4b78-91a5-47c1204ea77a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:21.107863 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493e251b-34fd-4b78-91a5-47c1204ea77a None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:21.128776 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application [None req-493e251b-34fd-4b78-91a5-47c1204ea77a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 08:27:21.128776 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:27:21.128776 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:27:21.128776 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:27:21.128776 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:27:21.128776 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:27:21.128776 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:27:21.128776 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:27:21.128776 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:27:21.128776 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:27:21.128776 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:27:21.128776 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:27:21.128776 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 08:27:21.128776 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 08:27:21.128776 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 08:27:21.129741 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 08:27:21.129741 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:27:21.129741 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:27:21.129741 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:27:21.129741 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:27:21.129741 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:27:21.129741 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:27:21.129741 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:27:21.129741 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application with Lock( May 27 08:27:21.129741 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:27:21.129741 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._enter() May 27 08:27:21.129741 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:27:21.129741 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:27:21.129741 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:27:21.129741 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.creator() May 27 08:27:21.129741 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:27:21.129741 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application created_value = creator( May 27 08:27:21.130627 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 08:27:21.130627 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 08:27:21.130627 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 08:27:21.130627 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application May 27 08:27:21.130627 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 282/570] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 08:27:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 08:27:21.131639 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493e251b-34fd-4b78-91a5-47c1204ea77a None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:21.139451 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b426b225-eb78-4a73-a3dc-14a9a290fab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:21.140261 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b426b225-eb78-4a73-a3dc-14a9a290fab7 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:21.140549 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b426b225-eb78-4a73-a3dc-14a9a290fab7 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:21.140943 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b426b225-eb78-4a73-a3dc-14a9a290fab7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:21.150183 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b426b225-eb78-4a73-a3dc-14a9a290fab7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:21.151685 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b426b225-eb78-4a73-a3dc-14a9a290fab7 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:21.159267 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:21.175019 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application [None req-b426b225-eb78-4a73-a3dc-14a9a290fab7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 08:27:21.175019 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:27:21.175019 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:27:21.175019 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:27:21.175019 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:27:21.175019 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:27:21.175019 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:27:21.175019 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:27:21.175019 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:27:21.175019 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:27:21.175019 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:27:21.175019 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:27:21.175019 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 08:27:21.175019 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 08:27:21.175019 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 08:27:21.175994 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 08:27:21.175994 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:27:21.175994 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:27:21.175994 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:27:21.175994 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:27:21.175994 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:27:21.175994 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:27:21.175994 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:27:21.175994 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application with Lock( May 27 08:27:21.175994 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:27:21.175994 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._enter() May 27 08:27:21.175994 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:27:21.175994 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:27:21.175994 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:27:21.175994 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.creator() May 27 08:27:21.175994 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:27:21.175994 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application created_value = creator( May 27 08:27:21.176935 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 08:27:21.176935 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 08:27:21.176935 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 08:27:21.176935 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 08:27:21.176935 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 08:27:21.176935 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 08:27:21.176935 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 08:27:21.176935 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application May 27 08:27:21.180739 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 289/571] 10.222.0.62 () {56 vars in 1111 bytes} [Fri May 27 08:27:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 08:27:21.182002 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b426b225-eb78-4a73-a3dc-14a9a290fab7 None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:21.277960 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493e251b-34fd-4b78-91a5-47c1204ea77a None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:21.281934 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:21.314871 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b426b225-eb78-4a73-a3dc-14a9a290fab7 None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:21.315063 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaeaba0-6797-4d5f-a6f0-95beb4f19cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:21.315619 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaeaba0-6797-4d5f-a6f0-95beb4f19cb5 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:21.315901 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaeaba0-6797-4d5f-a6f0-95beb4f19cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:21.316182 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaeaba0-6797-4d5f-a6f0-95beb4f19cb5 None admin] PATH_INFO: `/v3/users` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:21.317047 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edaeaba0-6797-4d5f-a6f0-95beb4f19cb5 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:27:21.317367 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edaeaba0-6797-4d5f-a6f0-95beb4f19cb5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:21.318813 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edaeaba0-6797-4d5f-a6f0-95beb4f19cb5 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:21.336966 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 283/572] 10.222.0.62 () {56 vars in 1139 bytes} [Fri May 27 08:27:21 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:27:21.338040 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaeaba0-6797-4d5f-a6f0-95beb4f19cb5 None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:21.359076 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dab9cfa-255b-4f94-9f59-60b803e3d157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:21.360154 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dab9cfa-255b-4f94-9f59-60b803e3d157 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:21.361371 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dab9cfa-255b-4f94-9f59-60b803e3d157 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:21.361884 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dab9cfa-255b-4f94-9f59-60b803e3d157 None admin] PATH_INFO: `/v3/domains` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:21.363280 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dab9cfa-255b-4f94-9f59-60b803e3d157 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:27:21.363833 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dab9cfa-255b-4f94-9f59-60b803e3d157 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:21.365537 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dab9cfa-255b-4f94-9f59-60b803e3d157 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:21.380075 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 290/573] 10.222.0.62 () {56 vars in 1109 bytes} [Fri May 27 08:27:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:27:21.380930 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dab9cfa-255b-4f94-9f59-60b803e3d157 None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:21.434392 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:21.460224 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaeaba0-6797-4d5f-a6f0-95beb4f19cb5 None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:21.489345 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dab9cfa-255b-4f94-9f59-60b803e3d157 None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:21.498949 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27148695-e5e2-4914-ad78-252686398717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:21.499619 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27148695-e5e2-4914-ad78-252686398717 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:21.499908 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27148695-e5e2-4914-ad78-252686398717 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:21.500182 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27148695-e5e2-4914-ad78-252686398717 None admin] PATH_INFO: `/v3/projects` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:21.501089 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27148695-e5e2-4914-ad78-252686398717 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:27:21.501450 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27148695-e5e2-4914-ad78-252686398717 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:21.503282 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27148695-e5e2-4914-ad78-252686398717 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:21.515032 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 284/574] 10.222.0.62 () {56 vars in 1148 bytes} [Fri May 27 08:27:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:27:21.515832 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27148695-e5e2-4914-ad78-252686398717 None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:21.529165 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:21.537006 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddfe14f-e638-48f2-8c62-c13f0742ca12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:21.537800 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddfe14f-e638-48f2-8c62-c13f0742ca12 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:21.538175 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddfe14f-e638-48f2-8c62-c13f0742ca12 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:21.538582 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddfe14f-e638-48f2-8c62-c13f0742ca12 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:21.550150 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddfe14f-e638-48f2-8c62-c13f0742ca12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:21.551612 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddfe14f-e638-48f2-8c62-c13f0742ca12 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:21.570820 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application [None req-5ddfe14f-e638-48f2-8c62-c13f0742ca12 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 08:27:21.570820 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:27:21.570820 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:27:21.570820 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:27:21.570820 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:27:21.570820 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:27:21.570820 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:27:21.570820 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:27:21.570820 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:27:21.570820 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:27:21.570820 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:27:21.570820 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:27:21.570820 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 08:27:21.570820 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 08:27:21.570820 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 08:27:21.571786 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 08:27:21.571786 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:27:21.571786 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:27:21.571786 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:27:21.571786 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:27:21.571786 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:27:21.571786 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:27:21.571786 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:27:21.571786 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application with Lock( May 27 08:27:21.571786 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:27:21.571786 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._enter() May 27 08:27:21.571786 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:27:21.571786 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:27:21.571786 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:27:21.571786 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.creator() May 27 08:27:21.571786 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:27:21.571786 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application created_value = creator( May 27 08:27:21.572711 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 08:27:21.572711 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 08:27:21.572711 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 08:27:21.572711 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application May 27 08:27:21.576765 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 291/575] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 08:27:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 08:27:21.577612 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddfe14f-e638-48f2-8c62-c13f0742ca12 None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:21.630364 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27148695-e5e2-4914-ad78-252686398717 None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:21.672851 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa6f8f5-a1b8-43dc-b678-2b41a679f575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:21.673715 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa6f8f5-a1b8-43dc-b678-2b41a679f575 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:21.673927 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa6f8f5-a1b8-43dc-b678-2b41a679f575 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:21.674207 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa6f8f5-a1b8-43dc-b678-2b41a679f575 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:21.677330 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:21.682989 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa6f8f5-a1b8-43dc-b678-2b41a679f575 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:21.684784 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa6f8f5-a1b8-43dc-b678-2b41a679f575 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:21.691382 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddfe14f-e638-48f2-8c62-c13f0742ca12 None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:21.700850 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application [None req-9aa6f8f5-a1b8-43dc-b678-2b41a679f575 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 08:27:21.700850 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:27:21.700850 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:27:21.700850 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:27:21.700850 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:27:21.700850 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:27:21.700850 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:27:21.700850 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:27:21.700850 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:27:21.700850 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:27:21.700850 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:27:21.700850 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:27:21.700850 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 08:27:21.700850 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 08:27:21.700850 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 08:27:21.701765 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 08:27:21.701765 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:27:21.701765 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:27:21.701765 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:27:21.701765 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:27:21.701765 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:27:21.701765 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:27:21.701765 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:27:21.701765 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application with Lock( May 27 08:27:21.701765 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:27:21.701765 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._enter() May 27 08:27:21.701765 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:27:21.701765 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:27:21.701765 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:27:21.701765 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.creator() May 27 08:27:21.701765 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:27:21.701765 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application created_value = creator( May 27 08:27:21.702669 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 08:27:21.702669 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 08:27:21.702669 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 08:27:21.702669 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 08:27:21.702669 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 08:27:21.702669 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 08:27:21.702669 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 08:27:21.702669 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application May 27 08:27:21.702669 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 285/576] 10.222.0.62 () {56 vars in 1111 bytes} [Fri May 27 08:27:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 08:27:21.703574 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa6f8f5-a1b8-43dc-b678-2b41a679f575 None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:21.730800 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6d0a34-108e-4b9c-870e-bed721e0d499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:21.732038 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6d0a34-108e-4b9c-870e-bed721e0d499 None admin] REQUEST_METHOD: `PUT` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:21.732539 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6d0a34-108e-4b9c-870e-bed721e0d499 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:21.732912 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6d0a34-108e-4b9c-870e-bed721e0d499 None admin] PATH_INFO: `/v3/projects/256f4731060449f1b80067e51e8bec00/users/839e73c51c5243b68335242a0d695842/roles/d15a26a31e9f4cad8e2c934cf892d50d` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:21.749596 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6d0a34-108e-4b9c-870e-bed721e0d499 None admin] RBAC: Authorizing `identity:create_grant(project_id=256f4731060449f1b80067e51e8bec00, user_id=839e73c51c5243b68335242a0d695842, role_id=d15a26a31e9f4cad8e2c934cf892d50d)` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:21.751671 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6d0a34-108e-4b9c-870e-bed721e0d499 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:21.765361 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 292/577] 10.222.0.62 () {58 vars in 1439 bytes} [Fri May 27 08:27:21 2022] PUT /identity/v3/projects/256f4731060449f1b80067e51e8bec00/users/839e73c51c5243b68335242a0d695842/roles/d15a26a31e9f4cad8e2c934cf892d50d => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 08:27:21.773720 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6d0a34-108e-4b9c-870e-bed721e0d499 None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:21.826131 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa6f8f5-a1b8-43dc-b678-2b41a679f575 None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:21.830172 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:21.873332 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac30c510-cf1b-463e-8438-bf6625edd698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:21.874059 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac30c510-cf1b-463e-8438-bf6625edd698 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:21.874352 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac30c510-cf1b-463e-8438-bf6625edd698 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:21.874687 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac30c510-cf1b-463e-8438-bf6625edd698 None admin] PATH_INFO: `/v3/domains` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:21.875446 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac30c510-cf1b-463e-8438-bf6625edd698 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:27:21.875755 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac30c510-cf1b-463e-8438-bf6625edd698 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:21.877869 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac30c510-cf1b-463e-8438-bf6625edd698 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:21.897576 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 286/578] 10.222.0.62 () {56 vars in 1109 bytes} [Fri May 27 08:27:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:27:21.900282 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac30c510-cf1b-463e-8438-bf6625edd698 None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:21.934591 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6d0a34-108e-4b9c-870e-bed721e0d499 None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:21.978382 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0922cf6d-72a5-4595-9e1f-f099090ee633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:21.979176 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0922cf6d-72a5-4595-9e1f-f099090ee633 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:21.979534 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0922cf6d-72a5-4595-9e1f-f099090ee633 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:21.979883 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0922cf6d-72a5-4595-9e1f-f099090ee633 None admin] PATH_INFO: `/v3/projects` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:21.981058 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0922cf6d-72a5-4595-9e1f-f099090ee633 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:27:21.981058 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0922cf6d-72a5-4595-9e1f-f099090ee633 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:21.982740 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0922cf6d-72a5-4595-9e1f-f099090ee633 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:21.985782 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:21.997876 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 293/579] 10.222.0.62 () {56 vars in 1148 bytes} [Fri May 27 08:27:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:27:22.004007 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0922cf6d-72a5-4595-9e1f-f099090ee633 None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:22.042885 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac30c510-cf1b-463e-8438-bf6625edd698 None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:22.079607 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e769ba8-a045-4d68-8194-c2bbe53bae60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:22.080625 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e769ba8-a045-4d68-8194-c2bbe53bae60 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:22.081054 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e769ba8-a045-4d68-8194-c2bbe53bae60 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:22.081496 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e769ba8-a045-4d68-8194-c2bbe53bae60 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:22.088831 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e769ba8-a045-4d68-8194-c2bbe53bae60 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:22.090431 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e769ba8-a045-4d68-8194-c2bbe53bae60 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:22.106007 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application [None req-3e769ba8-a045-4d68-8194-c2bbe53bae60 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 08:27:22.106007 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:27:22.106007 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:27:22.106007 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:27:22.106007 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:27:22.106007 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:27:22.106007 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:27:22.106007 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:27:22.106007 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:27:22.106007 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:27:22.106007 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:27:22.106007 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:27:22.106007 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 08:27:22.106007 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 08:27:22.106007 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 08:27:22.107076 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 08:27:22.107076 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:27:22.107076 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:27:22.107076 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:27:22.107076 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:27:22.107076 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:27:22.107076 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:27:22.107076 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:27:22.107076 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application with Lock( May 27 08:27:22.107076 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:27:22.107076 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._enter() May 27 08:27:22.107076 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:27:22.107076 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:27:22.107076 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:27:22.107076 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.creator() May 27 08:27:22.107076 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:27:22.107076 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application created_value = creator( May 27 08:27:22.107951 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 08:27:22.107951 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 08:27:22.107951 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 08:27:22.107951 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 08:27:22.107951 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 08:27:22.107951 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 08:27:22.107951 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 08:27:22.107951 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application May 27 08:27:22.107951 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 287/580] 10.222.0.62 () {56 vars in 1111 bytes} [Fri May 27 08:27:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 08:27:22.113471 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e769ba8-a045-4d68-8194-c2bbe53bae60 None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:22.121112 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:22.131409 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0922cf6d-72a5-4595-9e1f-f099090ee633 None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:22.179541 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd586c3-0a0d-4c8f-9655-13da325b57f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:22.181228 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd586c3-0a0d-4c8f-9655-13da325b57f5 None admin] REQUEST_METHOD: `PUT` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:22.181750 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd586c3-0a0d-4c8f-9655-13da325b57f5 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:22.182153 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd586c3-0a0d-4c8f-9655-13da325b57f5 None admin] PATH_INFO: `/v3/projects/256f4731060449f1b80067e51e8bec00/users/2af5ebcf47654d08881584431b199416/roles/d15a26a31e9f4cad8e2c934cf892d50d` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:22.206192 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd586c3-0a0d-4c8f-9655-13da325b57f5 None admin] RBAC: Authorizing `identity:create_grant(project_id=256f4731060449f1b80067e51e8bec00, user_id=2af5ebcf47654d08881584431b199416, role_id=d15a26a31e9f4cad8e2c934cf892d50d)` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:22.208059 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd586c3-0a0d-4c8f-9655-13da325b57f5 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:22.229573 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 294/581] 10.222.0.62 () {58 vars in 1439 bytes} [Fri May 27 08:27:22 2022] PUT /identity/v3/projects/256f4731060449f1b80067e51e8bec00/users/2af5ebcf47654d08881584431b199416/roles/d15a26a31e9f4cad8e2c934cf892d50d => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 08:27:22.235114 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e769ba8-a045-4d68-8194-c2bbe53bae60 None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:22.258820 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:22.283311 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aae501a-246f-4992-9c92-c016c9d99325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:22.284257 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aae501a-246f-4992-9c92-c016c9d99325 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:22.284556 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aae501a-246f-4992-9c92-c016c9d99325 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:22.284864 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aae501a-246f-4992-9c92-c016c9d99325 None admin] PATH_INFO: `/v3/projects` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:22.285675 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aae501a-246f-4992-9c92-c016c9d99325 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:27:22.286242 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aae501a-246f-4992-9c92-c016c9d99325 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:22.287877 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aae501a-246f-4992-9c92-c016c9d99325 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:22.303809 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 288/582] 10.222.0.62 () {56 vars in 1148 bytes} [Fri May 27 08:27:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:27:22.309317 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd586c3-0a0d-4c8f-9655-13da325b57f5 None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:22.429481 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd586c3-0a0d-4c8f-9655-13da325b57f5 None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:22.466839 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dd632f-17e0-4211-9e02-0962e345e34d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:22.467659 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dd632f-17e0-4211-9e02-0962e345e34d None admin] REQUEST_METHOD: `PUT` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:22.467942 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dd632f-17e0-4211-9e02-0962e345e34d None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:22.468217 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dd632f-17e0-4211-9e02-0962e345e34d None admin] PATH_INFO: `/v3/projects/256f4731060449f1b80067e51e8bec00/users/56934ba9afb741679e0573167d6825f5/roles/d15a26a31e9f4cad8e2c934cf892d50d` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:22.491300 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dd632f-17e0-4211-9e02-0962e345e34d None admin] RBAC: Authorizing `identity:create_grant(project_id=256f4731060449f1b80067e51e8bec00, user_id=56934ba9afb741679e0573167d6825f5, role_id=d15a26a31e9f4cad8e2c934cf892d50d)` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:22.492889 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dd632f-17e0-4211-9e02-0962e345e34d None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:22.496963 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:22.511233 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 295/583] 10.222.0.62 () {58 vars in 1439 bytes} [Fri May 27 08:27:22 2022] PUT /identity/v3/projects/256f4731060449f1b80067e51e8bec00/users/56934ba9afb741679e0573167d6825f5/roles/d15a26a31e9f4cad8e2c934cf892d50d => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 08:27:22.739285 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32966925-9921-4c7e-b462-8638e0abc20f None None] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:22.739778 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32966925-9921-4c7e-b462-8638e0abc20f None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:22.740004 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32966925-9921-4c7e-b462-8638e0abc20f None None] PATH_INFO: `/` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:22.741830 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 289/584] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:27:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:27:22.747627 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86e7ec1-9466-4c17-9cf8-2fad1a027c3e None None] REQUEST_METHOD: `POST` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:22.748067 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86e7ec1-9466-4c17-9cf8-2fad1a027c3e None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:22.748423 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86e7ec1-9466-4c17-9cf8-2fad1a027c3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:22.766381 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.auth.core [None req-b86e7ec1-9466-4c17-9cf8-2fad1a027c3e None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:27:22.768184 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.fernet_utils [None req-b86e7ec1-9466-4c17-9cf8-2fad1a027c3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:27:22.849319 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 296/585] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:27:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 08:27:22.872776 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32966925-9921-4c7e-b462-8638e0abc20f None None] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:22.984548 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32966925-9921-4c7e-b462-8638e0abc20f None None] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:23.025165 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae6ca56-bd8b-4695-b2eb-5ea525cbdb3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:23.025891 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae6ca56-bd8b-4695-b2eb-5ea525cbdb3b None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:23.026180 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae6ca56-bd8b-4695-b2eb-5ea525cbdb3b None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:23.026465 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae6ca56-bd8b-4695-b2eb-5ea525cbdb3b None admin] PATH_INFO: `/v3/roles/service` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:23.038704 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae6ca56-bd8b-4695-b2eb-5ea525cbdb3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 08:27:23.046564 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application [None req-8ae6ca56-bd8b-4695-b2eb-5ea525cbdb3b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 08:27:23.046564 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:27:23.046564 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:27:23.046564 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:27:23.046564 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:27:23.046564 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:27:23.046564 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:27:23.046564 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:27:23.046564 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:27:23.046564 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:27:23.046564 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:27:23.046564 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:27:23.046564 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 08:27:23.046564 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 08:27:23.046564 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 08:27:23.046564 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 08:27:23.048984 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 08:27:23.048984 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 08:27:23.048984 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 08:27:23.048984 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 08:27:23.048984 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:27:23.048984 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:27:23.048984 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:27:23.048984 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:27:23.048984 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:27:23.048984 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:27:23.048984 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:27:23.048984 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application with Lock( May 27 08:27:23.048984 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:27:23.048984 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._enter() May 27 08:27:23.048984 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:27:23.048984 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:27:23.051027 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:27:23.051027 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.creator() May 27 08:27:23.051027 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:27:23.051027 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application created_value = creator( May 27 08:27:23.051027 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 08:27:23.051027 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 08:27:23.051027 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 08:27:23.051027 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 08:27:23.051027 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 08:27:23.051027 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 08:27:23.051027 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 08:27:23.051027 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application May 27 08:27:23.053088 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 290/586] 10.222.0.62 () {56 vars in 1102 bytes} [Fri May 27 08:27:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 08:27:23.054159 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86e7ec1-9466-4c17-9cf8-2fad1a027c3e None None] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:23.165186 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86e7ec1-9466-4c17-9cf8-2fad1a027c3e None None] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:23.191569 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:23.205349 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c14104-fc3e-492a-876a-0de9f6bec9d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:23.206031 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c14104-fc3e-492a-876a-0de9f6bec9d9 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:23.206320 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c14104-fc3e-492a-876a-0de9f6bec9d9 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:23.206600 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c14104-fc3e-492a-876a-0de9f6bec9d9 None admin] PATH_INFO: `/v3/roles` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:23.207358 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c14104-fc3e-492a-876a-0de9f6bec9d9 None admin] RBAC: Adding query filter params (name=service) {{(pid=87172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:27:23.207665 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c14104-fc3e-492a-876a-0de9f6bec9d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:23.209206 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c14104-fc3e-492a-876a-0de9f6bec9d9 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:23.223123 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 297/587] 10.222.0.62 () {56 vars in 1103 bytes} [Fri May 27 08:27:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 08:27:23.224458 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae6ca56-bd8b-4695-b2eb-5ea525cbdb3b None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:23.264461 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:23.350994 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae6ca56-bd8b-4695-b2eb-5ea525cbdb3b None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:23.392617 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cf34a8-992b-43d9-ba04-6d615c5e3830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:23.392617 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cf34a8-992b-43d9-ba04-6d615c5e3830 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:23.392617 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cf34a8-992b-43d9-ba04-6d615c5e3830 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:23.392617 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cf34a8-992b-43d9-ba04-6d615c5e3830 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:23.400151 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cf34a8-992b-43d9-ba04-6d615c5e3830 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:23.401681 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cf34a8-992b-43d9-ba04-6d615c5e3830 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:23.421162 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application [None req-84cf34a8-992b-43d9-ba04-6d615c5e3830 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 08:27:23.421162 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:27:23.421162 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:27:23.421162 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:27:23.421162 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:27:23.421162 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:27:23.421162 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:27:23.421162 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:27:23.421162 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:27:23.421162 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:27:23.421162 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:27:23.421162 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:27:23.421162 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 08:27:23.421162 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 08:27:23.421162 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 08:27:23.422116 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 08:27:23.422116 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:27:23.422116 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:27:23.422116 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:27:23.422116 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:27:23.422116 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:27:23.422116 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:27:23.422116 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:27:23.422116 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application with Lock( May 27 08:27:23.422116 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:27:23.422116 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._enter() May 27 08:27:23.422116 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:27:23.422116 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:27:23.422116 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:27:23.422116 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.creator() May 27 08:27:23.422116 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:27:23.422116 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application created_value = creator( May 27 08:27:23.423532 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 08:27:23.423532 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 08:27:23.423532 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 08:27:23.423532 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application May 27 08:27:23.427824 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 291/588] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 08:27:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 08:27:23.433763 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c14104-fc3e-492a-876a-0de9f6bec9d9 None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:23.545760 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c14104-fc3e-492a-876a-0de9f6bec9d9 None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:23.582597 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47273cd9-d21f-4bd2-94ed-7128160a2331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:23.583242 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47273cd9-d21f-4bd2-94ed-7128160a2331 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:23.583534 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47273cd9-d21f-4bd2-94ed-7128160a2331 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:23.583813 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47273cd9-d21f-4bd2-94ed-7128160a2331 None admin] PATH_INFO: `/v3/domains` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:23.584544 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47273cd9-d21f-4bd2-94ed-7128160a2331 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:27:23.584872 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47273cd9-d21f-4bd2-94ed-7128160a2331 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:23.586250 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47273cd9-d21f-4bd2-94ed-7128160a2331 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:23.603804 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 298/589] 10.222.0.62 () {56 vars in 1109 bytes} [Fri May 27 08:27:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:27:23.605173 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cf34a8-992b-43d9-ba04-6d615c5e3830 None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:23.720062 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cf34a8-992b-43d9-ba04-6d615c5e3830 None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:23.744972 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:23.761262 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d59b55b-6bdb-4bf1-97b0-19279c44eb81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:23.762254 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d59b55b-6bdb-4bf1-97b0-19279c44eb81 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:23.762638 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d59b55b-6bdb-4bf1-97b0-19279c44eb81 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:23.763220 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d59b55b-6bdb-4bf1-97b0-19279c44eb81 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:23.772338 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d59b55b-6bdb-4bf1-97b0-19279c44eb81 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:23.773921 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d59b55b-6bdb-4bf1-97b0-19279c44eb81 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:23.790344 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application [None req-6d59b55b-6bdb-4bf1-97b0-19279c44eb81 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 27 08:27:23.790344 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:27:23.790344 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:27:23.790344 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:27:23.790344 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:27:23.790344 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:27:23.790344 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:27:23.790344 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:27:23.790344 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:27:23.790344 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:27:23.790344 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:27:23.790344 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:27:23.790344 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 08:27:23.790344 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 08:27:23.790344 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 08:27:23.790344 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 08:27:23.791339 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:27:23.791339 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:27:23.791339 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 08:27:23.791339 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 08:27:23.791339 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 08:27:23.791339 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 08:27:23.791339 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:27:23.791339 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:27:23.791339 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:27:23.791339 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:27:23.791339 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:27:23.791339 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application with Lock( May 27 08:27:23.791339 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:27:23.791339 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._enter() May 27 08:27:23.791339 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:27:23.791339 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:27:23.791339 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:27:23.791339 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.creator() May 27 08:27:23.792379 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:27:23.792379 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application created_value = creator( May 27 08:27:23.792379 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 08:27:23.792379 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 08:27:23.792379 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 08:27:23.792379 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 08:27:23.792379 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 08:27:23.792379 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 08:27:23.792379 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 27 08:27:23.792379 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application May 27 08:27:23.796094 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 292/590] 10.222.0.62 () {56 vars in 1093 bytes} [Fri May 27 08:27:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 08:27:23.797537 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47273cd9-d21f-4bd2-94ed-7128160a2331 None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:23.851216 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:23.911273 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47273cd9-d21f-4bd2-94ed-7128160a2331 None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:23.948425 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7157d3-c66f-4ffe-b263-7fc4271c8494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:23.949140 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7157d3-c66f-4ffe-b263-7fc4271c8494 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:23.949428 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7157d3-c66f-4ffe-b263-7fc4271c8494 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:23.949704 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7157d3-c66f-4ffe-b263-7fc4271c8494 None admin] PATH_INFO: `/v3/users` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:23.950553 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7157d3-c66f-4ffe-b263-7fc4271c8494 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:27:23.950865 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7157d3-c66f-4ffe-b263-7fc4271c8494 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:23.952305 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7157d3-c66f-4ffe-b263-7fc4271c8494 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:23.976277 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 299/591] 10.222.0.62 () {56 vars in 1133 bytes} [Fri May 27 08:27:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:27:23.977763 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d59b55b-6bdb-4bf1-97b0-19279c44eb81 None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:24.083734 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d59b55b-6bdb-4bf1-97b0-19279c44eb81 None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:24.123531 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c98a8c8-8601-4533-bbde-22399d8a98e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:24.124203 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c98a8c8-8601-4533-bbde-22399d8a98e8 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:24.124492 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c98a8c8-8601-4533-bbde-22399d8a98e8 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:24.124801 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c98a8c8-8601-4533-bbde-22399d8a98e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:24.144729 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:24.199425 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c98a8c8-8601-4533-bbde-22399d8a98e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:24.200857 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c98a8c8-8601-4533-bbde-22399d8a98e8 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:24.314056 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 293/592] 10.222.0.62 () {58 vars in 1282 bytes} [Fri May 27 08:27:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 08:27:24.316829 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7157d3-c66f-4ffe-b263-7fc4271c8494 None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:24.319752 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c004617-a7eb-452d-ba26-b7d44277c219 None None] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:24.320046 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c004617-a7eb-452d-ba26-b7d44277c219 None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:24.320327 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c004617-a7eb-452d-ba26-b7d44277c219 None None] PATH_INFO: `/` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:24.322006 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 294/593] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:27:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 08:27:24.327093 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ee6dac-a1e1-4333-946b-e56e2b3ef0c6 None None] REQUEST_METHOD: `POST` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:24.327380 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ee6dac-a1e1-4333-946b-e56e2b3ef0c6 None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:24.327663 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ee6dac-a1e1-4333-946b-e56e2b3ef0c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:24.344700 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.auth.core [None req-45ee6dac-a1e1-4333-946b-e56e2b3ef0c6 None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:27:24.346076 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.fernet_utils [None req-45ee6dac-a1e1-4333-946b-e56e2b3ef0c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:27:24.393224 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:24.424624 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 295/594] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:27:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 08:27:24.451784 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ee6dac-a1e1-4333-946b-e56e2b3ef0c6 None None] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:24.465614 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7157d3-c66f-4ffe-b263-7fc4271c8494 None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:24.468520 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:24.507470 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc44242e-7f4d-44a4-9a12-7ea4d93fa3c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:24.508697 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc44242e-7f4d-44a4-9a12-7ea4d93fa3c1 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:24.509194 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc44242e-7f4d-44a4-9a12-7ea4d93fa3c1 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:24.509692 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc44242e-7f4d-44a4-9a12-7ea4d93fa3c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:24.521022 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc44242e-7f4d-44a4-9a12-7ea4d93fa3c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:24.522796 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc44242e-7f4d-44a4-9a12-7ea4d93fa3c1 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:24.546092 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application [None req-cc44242e-7f4d-44a4-9a12-7ea4d93fa3c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 08:27:24.546092 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:27:24.546092 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:27:24.546092 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:27:24.546092 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:27:24.546092 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:27:24.546092 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:27:24.546092 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:27:24.546092 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:27:24.546092 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:27:24.546092 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:27:24.546092 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:27:24.546092 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 08:27:24.546092 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 08:27:24.546092 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 08:27:24.547061 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 08:27:24.547061 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:27:24.547061 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:27:24.547061 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:27:24.547061 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:27:24.547061 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:27:24.547061 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:27:24.547061 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:27:24.547061 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application with Lock( May 27 08:27:24.547061 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:27:24.547061 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._enter() May 27 08:27:24.547061 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:27:24.547061 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:27:24.547061 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:27:24.547061 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.creator() May 27 08:27:24.547061 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:27:24.547061 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application created_value = creator( May 27 08:27:24.548740 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 08:27:24.548740 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 08:27:24.548740 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 08:27:24.548740 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application May 27 08:27:24.556819 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 300/595] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 08:27:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 08:27:24.559844 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc44242e-7f4d-44a4-9a12-7ea4d93fa3c1 None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:24.585052 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ee6dac-a1e1-4333-946b-e56e2b3ef0c6 None None] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:24.624855 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c590a1-c53e-4297-afcd-1023b9f982ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:24.626249 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c590a1-c53e-4297-afcd-1023b9f982ef None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:24.626854 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c590a1-c53e-4297-afcd-1023b9f982ef None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:24.627350 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c590a1-c53e-4297-afcd-1023b9f982ef None admin] PATH_INFO: `/v3/roles/service` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:24.638977 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c590a1-c53e-4297-afcd-1023b9f982ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 08:27:24.647822 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application [None req-d1c590a1-c53e-4297-afcd-1023b9f982ef None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 08:27:24.647822 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:27:24.647822 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:27:24.647822 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:27:24.647822 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:27:24.647822 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:27:24.647822 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:27:24.647822 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:27:24.647822 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:27:24.647822 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:27:24.647822 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:27:24.647822 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:27:24.647822 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 08:27:24.647822 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 08:27:24.647822 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 08:27:24.647822 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 08:27:24.648853 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 08:27:24.648853 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 08:27:24.648853 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 08:27:24.648853 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 08:27:24.648853 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:27:24.648853 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:27:24.648853 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:27:24.648853 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:27:24.648853 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:27:24.648853 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:27:24.648853 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:27:24.648853 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application with Lock( May 27 08:27:24.648853 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:27:24.648853 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._enter() May 27 08:27:24.648853 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:27:24.648853 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:27:24.649680 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:27:24.649680 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.creator() May 27 08:27:24.649680 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:27:24.649680 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application created_value = creator( May 27 08:27:24.649680 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 08:27:24.649680 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 08:27:24.649680 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 08:27:24.649680 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 08:27:24.649680 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 08:27:24.649680 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 08:27:24.649680 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 08:27:24.649680 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application May 27 08:27:24.656637 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 296/596] 10.222.0.62 () {56 vars in 1102 bytes} [Fri May 27 08:27:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 08:27:24.661462 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c590a1-c53e-4297-afcd-1023b9f982ef None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:24.681664 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc44242e-7f4d-44a4-9a12-7ea4d93fa3c1 None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:24.706045 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:24.723575 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d92cfc-3e39-4f09-9e31-7d72f1af18ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:24.724239 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d92cfc-3e39-4f09-9e31-7d72f1af18ce None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:24.724524 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d92cfc-3e39-4f09-9e31-7d72f1af18ce None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:24.724835 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d92cfc-3e39-4f09-9e31-7d72f1af18ce None admin] PATH_INFO: `/v3/domains` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:24.725566 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d92cfc-3e39-4f09-9e31-7d72f1af18ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=87172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:27:24.725872 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d92cfc-3e39-4f09-9e31-7d72f1af18ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:24.727263 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d92cfc-3e39-4f09-9e31-7d72f1af18ce None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:24.740254 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 301/597] 10.222.0.62 () {56 vars in 1109 bytes} [Fri May 27 08:27:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 08:27:24.740254 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301fdee3-d674-49cf-be33-3e7aa84fa37a None None] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:24.740254 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301fdee3-d674-49cf-be33-3e7aa84fa37a None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:24.740254 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301fdee3-d674-49cf-be33-3e7aa84fa37a None None] PATH_INFO: `/` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:24.740254 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 302/598] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:27:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:27:24.749130 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301fdee3-d674-49cf-be33-3e7aa84fa37a None None] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:24.771373 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:24.783566 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c590a1-c53e-4297-afcd-1023b9f982ef None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:24.819646 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180db0fa-4fce-4a56-a99f-526743340577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:24.820317 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180db0fa-4fce-4a56-a99f-526743340577 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:24.820622 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180db0fa-4fce-4a56-a99f-526743340577 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:24.820910 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180db0fa-4fce-4a56-a99f-526743340577 None admin] PATH_INFO: `/v3/roles` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:24.822070 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180db0fa-4fce-4a56-a99f-526743340577 None admin] RBAC: Adding query filter params (name=service) {{(pid=87173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:27:24.822369 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180db0fa-4fce-4a56-a99f-526743340577 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:24.824047 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180db0fa-4fce-4a56-a99f-526743340577 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:24.833439 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 297/599] 10.222.0.62 () {56 vars in 1103 bytes} [Fri May 27 08:27:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 08:27:24.834524 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f7709a-a1fc-4dca-9ec2-e7b8c94057c7 None None] REQUEST_METHOD: `POST` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:24.834810 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f7709a-a1fc-4dca-9ec2-e7b8c94057c7 None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:24.835097 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f7709a-a1fc-4dca-9ec2-e7b8c94057c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:24.852328 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.auth.core [None req-07f7709a-a1fc-4dca-9ec2-e7b8c94057c7 None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:27:24.853579 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.fernet_utils [None req-07f7709a-a1fc-4dca-9ec2-e7b8c94057c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:27:24.882945 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301fdee3-d674-49cf-be33-3e7aa84fa37a None None] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:24.922161 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5873b9-d4fc-4904-ba48-d5128278f488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:24.923835 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5873b9-d4fc-4904-ba48-d5128278f488 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:24.924268 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5873b9-d4fc-4904-ba48-d5128278f488 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:24.924732 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5873b9-d4fc-4904-ba48-d5128278f488 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:24.932455 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5873b9-d4fc-4904-ba48-d5128278f488 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:24.933419 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 298/600] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:27:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 08:27:24.934251 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f7709a-a1fc-4dca-9ec2-e7b8c94057c7 None None] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:24.934440 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5873b9-d4fc-4904-ba48-d5128278f488 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:24.960365 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application [None req-6a5873b9-d4fc-4904-ba48-d5128278f488 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 08:27:24.960365 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:27:24.960365 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:27:24.960365 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:27:24.960365 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:27:24.960365 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:27:24.960365 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:27:24.960365 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:27:24.960365 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:27:24.960365 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:27:24.960365 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:27:24.960365 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:27:24.960365 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 08:27:24.960365 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 08:27:24.960365 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 08:27:24.961477 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 08:27:24.961477 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:27:24.961477 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:27:24.961477 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:27:24.961477 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:27:24.961477 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:27:24.961477 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:27:24.961477 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:27:24.961477 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application with Lock( May 27 08:27:24.961477 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:27:24.961477 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._enter() May 27 08:27:24.961477 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:27:24.961477 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:27:24.961477 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:27:24.961477 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.creator() May 27 08:27:24.961477 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:27:24.961477 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application created_value = creator( May 27 08:27:24.962388 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 08:27:24.962388 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 08:27:24.962388 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 08:27:24.962388 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 08:27:24.962388 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 08:27:24.962388 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 08:27:24.962388 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 08:27:24.962388 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application May 27 08:27:24.962388 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 303/601] 10.222.0.62 () {56 vars in 1111 bytes} [Fri May 27 08:27:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 08:27:24.962941 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b7a5eb-0bdb-4ff6-859b-4354ccdff6e8 None None] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:24.963058 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b7a5eb-0bdb-4ff6-859b-4354ccdff6e8 None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:24.963335 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b7a5eb-0bdb-4ff6-859b-4354ccdff6e8 None None] PATH_INFO: `/` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:24.964607 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 304/602] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:27:24 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:27:24.968948 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b7a5eb-0bdb-4ff6-859b-4354ccdff6e8 None None] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:24.979173 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:25.048748 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:25.054357 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f7709a-a1fc-4dca-9ec2-e7b8c94057c7 None None] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:25.073455 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b7a5eb-0bdb-4ff6-859b-4354ccdff6e8 None None] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:25.087361 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff761340-0359-4ee6-bb22-3978c9190d6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:25.088144 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff761340-0359-4ee6-bb22-3978c9190d6e None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:25.088424 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff761340-0359-4ee6-bb22-3978c9190d6e None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:25.088729 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff761340-0359-4ee6-bb22-3978c9190d6e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:25.099538 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff761340-0359-4ee6-bb22-3978c9190d6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:25.101033 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff761340-0359-4ee6-bb22-3978c9190d6e None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:25.107620 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaca756-8c8f-4a50-9204-4336a9f9bc1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:25.108279 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaca756-8c8f-4a50-9204-4336a9f9bc1d None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:25.108566 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaca756-8c8f-4a50-9204-4336a9f9bc1d None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:25.108874 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaca756-8c8f-4a50-9204-4336a9f9bc1d None admin] PATH_INFO: `/v3/projects` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:25.109658 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaca756-8c8f-4a50-9204-4336a9f9bc1d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:27:25.109995 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaca756-8c8f-4a50-9204-4336a9f9bc1d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:25.111536 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaca756-8c8f-4a50-9204-4336a9f9bc1d None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:25.118328 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application [None req-ff761340-0359-4ee6-bb22-3978c9190d6e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 08:27:25.118328 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:27:25.118328 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:27:25.118328 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:27:25.118328 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:27:25.118328 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:27:25.118328 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:27:25.118328 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:27:25.118328 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:27:25.118328 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:27:25.118328 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:27:25.118328 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:27:25.118328 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 08:27:25.118328 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 08:27:25.118328 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 08:27:25.119377 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 08:27:25.119377 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:27:25.119377 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:27:25.119377 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:27:25.119377 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:27:25.119377 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:27:25.119377 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:27:25.119377 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:27:25.119377 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application with Lock( May 27 08:27:25.119377 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:27:25.119377 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._enter() May 27 08:27:25.119377 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:27:25.119377 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:27:25.119377 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:27:25.119377 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.creator() May 27 08:27:25.119377 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:27:25.119377 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application created_value = creator( May 27 08:27:25.120300 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 08:27:25.120300 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 08:27:25.120300 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 08:27:25.120300 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application May 27 08:27:25.120300 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 299/603] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 08:27:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 08:27:25.120693 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330f0d2f-9d61-4601-be27-e6b915a9b964 None None] REQUEST_METHOD: `POST` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:25.120970 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330f0d2f-9d61-4601-be27-e6b915a9b964 None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:25.121246 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330f0d2f-9d61-4601-be27-e6b915a9b964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:25.128126 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 305/604] 10.222.0.62 () {56 vars in 1148 bytes} [Fri May 27 08:27:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:27:25.129284 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaca756-8c8f-4a50-9204-4336a9f9bc1d None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:25.142640 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.auth.core [None req-330f0d2f-9d61-4601-be27-e6b915a9b964 None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:27:25.145649 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.fernet_utils [None req-330f0d2f-9d61-4601-be27-e6b915a9b964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:27:25.222036 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 300/605] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:27:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 08:27:25.222619 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330f0d2f-9d61-4601-be27-e6b915a9b964 None None] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:25.238443 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:25.246595 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaca756-8c8f-4a50-9204-4336a9f9bc1d None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:25.283076 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c79d32b-3c94-4d89-b7f5-b67d1f66849e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:25.283864 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c79d32b-3c94-4d89-b7f5-b67d1f66849e None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:25.284143 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c79d32b-3c94-4d89-b7f5-b67d1f66849e None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:25.284415 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c79d32b-3c94-4d89-b7f5-b67d1f66849e None admin] PATH_INFO: `/v3/roles/service` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:25.287627 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:25.296700 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c79d32b-3c94-4d89-b7f5-b67d1f66849e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 08:27:25.304658 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application [None req-7c79d32b-3c94-4d89-b7f5-b67d1f66849e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 08:27:25.304658 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:27:25.304658 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:27:25.304658 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:27:25.304658 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:27:25.304658 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:27:25.304658 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:27:25.304658 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:27:25.304658 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:27:25.304658 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:27:25.304658 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:27:25.304658 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:27:25.304658 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 08:27:25.304658 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 08:27:25.304658 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 08:27:25.304658 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 08:27:25.305610 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 08:27:25.305610 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 08:27:25.305610 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 08:27:25.305610 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 08:27:25.305610 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:27:25.305610 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:27:25.305610 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:27:25.305610 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:27:25.305610 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:27:25.305610 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:27:25.305610 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:27:25.305610 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application with Lock( May 27 08:27:25.305610 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:27:25.305610 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._enter() May 27 08:27:25.305610 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:27:25.305610 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:27:25.306449 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:27:25.306449 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.creator() May 27 08:27:25.306449 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:27:25.306449 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application created_value = creator( May 27 08:27:25.306449 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 08:27:25.306449 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 08:27:25.306449 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 08:27:25.306449 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 08:27:25.306449 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 08:27:25.306449 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 08:27:25.306449 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 08:27:25.306449 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application May 27 08:27:25.306449 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 306/606] 10.222.0.62 () {56 vars in 1102 bytes} [Fri May 27 08:27:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 08:27:25.307129 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c79d32b-3c94-4d89-b7f5-b67d1f66849e None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:25.327385 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330f0d2f-9d61-4601-be27-e6b915a9b964 None None] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:25.367508 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebac27b0-33c9-446a-a46e-abe29fa0614a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:25.368195 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebac27b0-33c9-446a-a46e-abe29fa0614a None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:25.368503 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebac27b0-33c9-446a-a46e-abe29fa0614a None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:25.368892 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebac27b0-33c9-446a-a46e-abe29fa0614a None admin] PATH_INFO: `/v3/domains` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:25.369655 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebac27b0-33c9-446a-a46e-abe29fa0614a None admin] RBAC: Adding query filter params (name=Default) {{(pid=87173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:27:25.369966 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebac27b0-33c9-446a-a46e-abe29fa0614a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:25.371353 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebac27b0-33c9-446a-a46e-abe29fa0614a None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:25.384135 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 301/607] 10.222.0.62 () {56 vars in 1109 bytes} [Fri May 27 08:27:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:27:25.385136 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebac27b0-33c9-446a-a46e-abe29fa0614a None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:25.414845 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c79d32b-3c94-4d89-b7f5-b67d1f66849e None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:25.448665 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3de245-3026-48c9-b0b4-b8ed5330ff51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:25.449314 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3de245-3026-48c9-b0b4-b8ed5330ff51 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:25.449593 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3de245-3026-48c9-b0b4-b8ed5330ff51 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:25.449869 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3de245-3026-48c9-b0b4-b8ed5330ff51 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:25.450689 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3de245-3026-48c9-b0b4-b8ed5330ff51 None admin] RBAC: Adding query filter params (role.id=d15a26a31e9f4cad8e2c934cf892d50d, scope.project.id=256f4731060449f1b80067e51e8bec00, user.id=3a09bdc2dbac4f9abe450ff121e7dce8) {{(pid=87172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:27:25.450994 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3de245-3026-48c9-b0b4-b8ed5330ff51 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:25.452481 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3de245-3026-48c9-b0b4-b8ed5330ff51 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:25.456608 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:25.460089 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 307/608] 10.222.0.62 () {56 vars in 1374 bytes} [Fri May 27 08:27:25 2022] GET /identity/v3/role_assignments?user.id=3a09bdc2dbac4f9abe450ff121e7dce8&scope.project.id=256f4731060449f1b80067e51e8bec00&role.id=d15a26a31e9f4cad8e2c934cf892d50d => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:27:25.460952 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3de245-3026-48c9-b0b4-b8ed5330ff51 None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:25.495069 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebac27b0-33c9-446a-a46e-abe29fa0614a None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:25.536618 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:25.537387 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191de066-b0fb-4ea8-b8bb-3ea65ffe2518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:25.538284 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191de066-b0fb-4ea8-b8bb-3ea65ffe2518 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:25.538815 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191de066-b0fb-4ea8-b8bb-3ea65ffe2518 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:25.539094 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191de066-b0fb-4ea8-b8bb-3ea65ffe2518 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:25.552422 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191de066-b0fb-4ea8-b8bb-3ea65ffe2518 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 08:27:25.560422 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application [None req-191de066-b0fb-4ea8-b8bb-3ea65ffe2518 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 08:27:25.560422 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:27:25.560422 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:27:25.560422 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:27:25.560422 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:27:25.560422 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:27:25.560422 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:27:25.560422 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:27:25.560422 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:27:25.560422 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:27:25.560422 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:27:25.560422 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:27:25.560422 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 08:27:25.560422 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 08:27:25.560422 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 08:27:25.560422 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 08:27:25.561609 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 08:27:25.561609 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 08:27:25.561609 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 08:27:25.561609 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 08:27:25.561609 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:27:25.561609 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:27:25.561609 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:27:25.561609 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:27:25.561609 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:27:25.561609 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:27:25.561609 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:27:25.561609 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application with Lock( May 27 08:27:25.561609 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:27:25.561609 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._enter() May 27 08:27:25.561609 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:27:25.561609 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:27:25.562569 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:27:25.562569 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.creator() May 27 08:27:25.562569 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:27:25.562569 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application created_value = creator( May 27 08:27:25.562569 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 08:27:25.562569 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 08:27:25.562569 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 08:27:25.562569 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 08:27:25.562569 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 08:27:25.562569 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 08:27:25.562569 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 08:27:25.562569 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application May 27 08:27:25.562569 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 302/609] 10.222.0.62 () {56 vars in 1102 bytes} [Fri May 27 08:27:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 08:27:25.565607 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191de066-b0fb-4ea8-b8bb-3ea65ffe2518 None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:25.590825 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3de245-3026-48c9-b0b4-b8ed5330ff51 None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:25.630579 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d3e2cb-2956-443a-9dd8-fc9211929433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:25.631257 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d3e2cb-2956-443a-9dd8-fc9211929433 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:25.631544 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d3e2cb-2956-443a-9dd8-fc9211929433 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:25.631827 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d3e2cb-2956-443a-9dd8-fc9211929433 None admin] PATH_INFO: `/v3/roles` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:25.635730 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d3e2cb-2956-443a-9dd8-fc9211929433 None admin] RBAC: Adding query filter params (name=service) {{(pid=87172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:27:25.635730 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d3e2cb-2956-443a-9dd8-fc9211929433 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:25.635730 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d3e2cb-2956-443a-9dd8-fc9211929433 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:25.647279 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 308/610] 10.222.0.62 () {56 vars in 1103 bytes} [Fri May 27 08:27:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:27:25.648036 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d3e2cb-2956-443a-9dd8-fc9211929433 None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:25.692550 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191de066-b0fb-4ea8-b8bb-3ea65ffe2518 None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:25.731997 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:25.738054 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc518df-4292-4b7c-820b-6ebed35281f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:25.738870 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc518df-4292-4b7c-820b-6ebed35281f5 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:25.739205 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc518df-4292-4b7c-820b-6ebed35281f5 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:25.739504 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc518df-4292-4b7c-820b-6ebed35281f5 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:25.748193 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc518df-4292-4b7c-820b-6ebed35281f5 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:25.749650 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc518df-4292-4b7c-820b-6ebed35281f5 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:25.764797 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application [None req-2fc518df-4292-4b7c-820b-6ebed35281f5 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 27 08:27:25.764797 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:27:25.764797 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:27:25.764797 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:27:25.764797 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:27:25.764797 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:27:25.764797 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:27:25.764797 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:27:25.764797 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:27:25.764797 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:27:25.764797 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:27:25.764797 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:27:25.764797 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 08:27:25.764797 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 08:27:25.764797 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 08:27:25.764797 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 08:27:25.765930 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:27:25.765930 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:27:25.765930 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 08:27:25.765930 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 08:27:25.765930 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 08:27:25.765930 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 08:27:25.765930 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:27:25.765930 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:27:25.765930 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:27:25.765930 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:27:25.765930 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:27:25.765930 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application with Lock( May 27 08:27:25.765930 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:27:25.765930 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._enter() May 27 08:27:25.765930 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:27:25.765930 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:27:25.765930 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:27:25.765930 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.creator() May 27 08:27:25.767203 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:27:25.767203 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application created_value = creator( May 27 08:27:25.767203 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 08:27:25.767203 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 08:27:25.767203 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 08:27:25.767203 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 08:27:25.767203 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 08:27:25.767203 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 08:27:25.767203 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 27 08:27:25.767203 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application May 27 08:27:25.767203 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 303/611] 10.222.0.62 () {56 vars in 1099 bytes} [Fri May 27 08:27:25 2022] GET /identity/v3/users/cinder => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 08:27:25.767203 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc518df-4292-4b7c-820b-6ebed35281f5 None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:25.770660 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d3e2cb-2956-443a-9dd8-fc9211929433 None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:25.796214 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:25.810481 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c29573-e8e1-427b-990d-ae2172b21ba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:25.811202 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c29573-e8e1-427b-990d-ae2172b21ba7 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:25.811473 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c29573-e8e1-427b-990d-ae2172b21ba7 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:25.811752 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c29573-e8e1-427b-990d-ae2172b21ba7 None admin] PATH_INFO: `/v3/roles` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:25.812506 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c29573-e8e1-427b-990d-ae2172b21ba7 None admin] RBAC: Adding query filter params (name=service) {{(pid=87172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:27:25.812844 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c29573-e8e1-427b-990d-ae2172b21ba7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:25.814771 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c29573-e8e1-427b-990d-ae2172b21ba7 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:25.825048 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 309/612] 10.222.0.62 () {56 vars in 1103 bytes} [Fri May 27 08:27:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:27:25.826215 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c29573-e8e1-427b-990d-ae2172b21ba7 None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:25.897729 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc518df-4292-4b7c-820b-6ebed35281f5 None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:25.939741 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c66810-2566-4ce7-954c-41aa572e2219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:25.940533 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c66810-2566-4ce7-954c-41aa572e2219 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:25.940850 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c66810-2566-4ce7-954c-41aa572e2219 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:25.941136 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c66810-2566-4ce7-954c-41aa572e2219 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:25.947067 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c29573-e8e1-427b-990d-ae2172b21ba7 None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:25.952140 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c66810-2566-4ce7-954c-41aa572e2219 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:25.953631 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c66810-2566-4ce7-954c-41aa572e2219 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:25.971619 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application [None req-14c66810-2566-4ce7-954c-41aa572e2219 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 08:27:25.971619 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:27:25.971619 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:27:25.971619 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:27:25.971619 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:27:25.971619 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:27:25.971619 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:27:25.971619 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:27:25.971619 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:27:25.971619 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:27:25.971619 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:27:25.971619 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:27:25.971619 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 08:27:25.971619 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 08:27:25.971619 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 08:27:25.972641 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 08:27:25.972641 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:27:25.972641 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:27:25.972641 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:27:25.972641 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:27:25.972641 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:27:25.972641 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:27:25.972641 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:27:25.972641 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application with Lock( May 27 08:27:25.972641 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:27:25.972641 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._enter() May 27 08:27:25.972641 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:27:25.972641 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:27:25.972641 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:27:25.972641 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.creator() May 27 08:27:25.972641 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:27:25.972641 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application created_value = creator( May 27 08:27:25.973558 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 08:27:25.973558 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 08:27:25.973558 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 08:27:25.973558 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application May 27 08:27:25.973558 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 304/613] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 08:27:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 08:27:25.973852 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c66810-2566-4ce7-954c-41aa572e2219 None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:25.988061 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1c9832-e321-42e4-98f8-168d1c31955a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:25.988772 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1c9832-e321-42e4-98f8-168d1c31955a None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:25.989061 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1c9832-e321-42e4-98f8-168d1c31955a None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:25.989341 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1c9832-e321-42e4-98f8-168d1c31955a None admin] PATH_INFO: `/v3/users` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:25.990187 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1c9832-e321-42e4-98f8-168d1c31955a None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:27:25.990496 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1c9832-e321-42e4-98f8-168d1c31955a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:25.991945 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1c9832-e321-42e4-98f8-168d1c31955a None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:26.015183 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 310/614] 10.222.0.62 () {56 vars in 1137 bytes} [Fri May 27 08:27:25 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:27:26.015183 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1c9832-e321-42e4-98f8-168d1c31955a None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:26.030145 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:26.057212 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:26.093594 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c66810-2566-4ce7-954c-41aa572e2219 None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:26.118689 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1c9832-e321-42e4-98f8-168d1c31955a None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:26.132455 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad55fbb6-f60f-4a6b-876c-d5fee343d3d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:26.133807 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad55fbb6-f60f-4a6b-876c-d5fee343d3d1 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:26.133807 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad55fbb6-f60f-4a6b-876c-d5fee343d3d1 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:26.133993 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad55fbb6-f60f-4a6b-876c-d5fee343d3d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:26.145616 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad55fbb6-f60f-4a6b-876c-d5fee343d3d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:26.147087 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad55fbb6-f60f-4a6b-876c-d5fee343d3d1 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:26.155830 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932e30e4-a0ea-497f-a86b-ca49aac39e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:26.156496 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932e30e4-a0ea-497f-a86b-ca49aac39e27 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:26.156807 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932e30e4-a0ea-497f-a86b-ca49aac39e27 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:26.157153 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932e30e4-a0ea-497f-a86b-ca49aac39e27 None admin] PATH_INFO: `/v3/domains` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:26.157885 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932e30e4-a0ea-497f-a86b-ca49aac39e27 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:27:26.158189 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932e30e4-a0ea-497f-a86b-ca49aac39e27 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:26.159605 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932e30e4-a0ea-497f-a86b-ca49aac39e27 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:26.165527 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application [None req-ad55fbb6-f60f-4a6b-876c-d5fee343d3d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 08:27:26.165527 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:27:26.165527 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:27:26.165527 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:27:26.165527 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:27:26.165527 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:27:26.165527 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:27:26.165527 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:27:26.165527 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:27:26.165527 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:27:26.165527 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:27:26.165527 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:27:26.165527 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 08:27:26.165527 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 08:27:26.165527 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 08:27:26.166612 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 08:27:26.166612 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:27:26.166612 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:27:26.166612 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:27:26.166612 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:27:26.166612 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:27:26.166612 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:27:26.166612 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:27:26.166612 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application with Lock( May 27 08:27:26.166612 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:27:26.166612 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._enter() May 27 08:27:26.166612 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:27:26.166612 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:27:26.166612 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:27:26.166612 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.creator() May 27 08:27:26.166612 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:27:26.166612 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application created_value = creator( May 27 08:27:26.173505 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 08:27:26.173505 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 08:27:26.173505 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 08:27:26.173505 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application May 27 08:27:26.173505 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 305/615] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 08:27:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 08:27:26.173505 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad55fbb6-f60f-4a6b-876c-d5fee343d3d1 None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:26.183604 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 311/616] 10.222.0.62 () {56 vars in 1109 bytes} [Fri May 27 08:27:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:27:26.183604 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932e30e4-a0ea-497f-a86b-ca49aac39e27 None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:26.275212 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:26.283508 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad55fbb6-f60f-4a6b-876c-d5fee343d3d1 None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:26.289781 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932e30e4-a0ea-497f-a86b-ca49aac39e27 None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:26.291339 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:26.322441 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361000b0-0330-42cb-a7c9-68ec722639f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:26.323279 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361000b0-0330-42cb-a7c9-68ec722639f2 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:26.323567 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361000b0-0330-42cb-a7c9-68ec722639f2 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:26.323937 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361000b0-0330-42cb-a7c9-68ec722639f2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:26.325720 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ac045c-4a2f-4b04-bd8d-92c068a1c1b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:26.326376 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ac045c-4a2f-4b04-bd8d-92c068a1c1b0 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:26.326658 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ac045c-4a2f-4b04-bd8d-92c068a1c1b0 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:26.326932 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ac045c-4a2f-4b04-bd8d-92c068a1c1b0 None admin] PATH_INFO: `/v3/domains` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:26.327671 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ac045c-4a2f-4b04-bd8d-92c068a1c1b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:27:26.327964 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ac045c-4a2f-4b04-bd8d-92c068a1c1b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:26.329975 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ac045c-4a2f-4b04-bd8d-92c068a1c1b0 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:26.342071 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 312/617] 10.222.0.62 () {56 vars in 1109 bytes} [Fri May 27 08:27:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:27:26.342902 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ac045c-4a2f-4b04-bd8d-92c068a1c1b0 None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:26.415078 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361000b0-0330-42cb-a7c9-68ec722639f2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:26.416562 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361000b0-0330-42cb-a7c9-68ec722639f2 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:26.450589 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ac045c-4a2f-4b04-bd8d-92c068a1c1b0 None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:26.491378 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f203d19-3d5a-4fb2-8f51-5292ddf1c6a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:26.492326 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f203d19-3d5a-4fb2-8f51-5292ddf1c6a0 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:26.492742 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f203d19-3d5a-4fb2-8f51-5292ddf1c6a0 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:26.493116 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f203d19-3d5a-4fb2-8f51-5292ddf1c6a0 None admin] PATH_INFO: `/v3/users/glance` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:26.501294 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f203d19-3d5a-4fb2-8f51-5292ddf1c6a0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:26.503345 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f203d19-3d5a-4fb2-8f51-5292ddf1c6a0 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:26.516053 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:26.520283 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application [None req-3f203d19-3d5a-4fb2-8f51-5292ddf1c6a0 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 27 08:27:26.520283 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:27:26.520283 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:27:26.520283 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:27:26.520283 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:27:26.520283 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:27:26.520283 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:27:26.520283 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:27:26.520283 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:27:26.520283 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:27:26.520283 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:27:26.520283 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:27:26.520283 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 08:27:26.520283 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 08:27:26.520283 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 08:27:26.520283 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 08:27:26.521448 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:27:26.521448 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:27:26.521448 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 08:27:26.521448 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 08:27:26.521448 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 08:27:26.521448 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 08:27:26.521448 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:27:26.521448 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:27:26.521448 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:27:26.521448 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:27:26.521448 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:27:26.521448 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application with Lock( May 27 08:27:26.521448 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:27:26.521448 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._enter() May 27 08:27:26.521448 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:27:26.521448 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:27:26.521448 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:27:26.521448 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.creator() May 27 08:27:26.522612 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:27:26.522612 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application created_value = creator( May 27 08:27:26.522612 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 08:27:26.522612 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 08:27:26.522612 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 08:27:26.522612 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 08:27:26.522612 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 08:27:26.522612 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 08:27:26.522612 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 27 08:27:26.522612 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application May 27 08:27:26.533045 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 313/618] 10.222.0.62 () {56 vars in 1099 bytes} [Fri May 27 08:27:26 2022] GET /identity/v3/users/glance => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 08:27:26.533045 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f203d19-3d5a-4fb2-8f51-5292ddf1c6a0 None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:26.533285 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 306/619] 10.222.0.62 () {58 vars in 1282 bytes} [Fri May 27 08:27:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 08:27:26.533285 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361000b0-0330-42cb-a7c9-68ec722639f2 None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:26.555812 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:26.646489 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f203d19-3d5a-4fb2-8f51-5292ddf1c6a0 None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:26.651233 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361000b0-0330-42cb-a7c9-68ec722639f2 None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:26.682816 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ade9a4-67df-489a-b051-f0fc7f5e8dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:26.683774 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ade9a4-67df-489a-b051-f0fc7f5e8dcf None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:26.684154 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ade9a4-67df-489a-b051-f0fc7f5e8dcf None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:26.684543 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ade9a4-67df-489a-b051-f0fc7f5e8dcf None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:26.690500 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac48014-b8ac-4a8d-96e2-a3605e264b36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:26.691177 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac48014-b8ac-4a8d-96e2-a3605e264b36 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:26.691463 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac48014-b8ac-4a8d-96e2-a3605e264b36 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:26.691750 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac48014-b8ac-4a8d-96e2-a3605e264b36 None admin] PATH_INFO: `/v3/users` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:26.692610 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac48014-b8ac-4a8d-96e2-a3605e264b36 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:27:26.692936 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac48014-b8ac-4a8d-96e2-a3605e264b36 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:26.693415 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ade9a4-67df-489a-b051-f0fc7f5e8dcf None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:26.694387 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac48014-b8ac-4a8d-96e2-a3605e264b36 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:26.695062 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ade9a4-67df-489a-b051-f0fc7f5e8dcf None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:26.710506 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application [None req-c5ade9a4-67df-489a-b051-f0fc7f5e8dcf None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 27 08:27:26.710506 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:27:26.710506 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:27:26.710506 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:27:26.710506 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:27:26.710506 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:27:26.710506 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:27:26.710506 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:27:26.710506 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:27:26.710506 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:27:26.710506 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:27:26.710506 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:27:26.710506 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 08:27:26.710506 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 08:27:26.710506 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 08:27:26.710506 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 08:27:26.711644 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:27:26.711644 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:27:26.711644 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 08:27:26.711644 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 08:27:26.711644 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 08:27:26.711644 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 08:27:26.711644 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:27:26.711644 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:27:26.711644 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:27:26.711644 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:27:26.711644 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:27:26.711644 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application with Lock( May 27 08:27:26.711644 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:27:26.711644 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._enter() May 27 08:27:26.711644 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:27:26.711644 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:27:26.711644 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:27:26.711644 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.creator() May 27 08:27:26.712622 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:27:26.712622 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application created_value = creator( May 27 08:27:26.712622 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 08:27:26.712622 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 08:27:26.712622 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 08:27:26.712622 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 08:27:26.712622 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 08:27:26.712622 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 08:27:26.712622 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 27 08:27:26.712622 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application May 27 08:27:26.712622 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 314/620] 10.222.0.62 () {56 vars in 1102 bytes} [Fri May 27 08:27:26 2022] GET /identity/v3/users/neutron => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 08:27:26.712622 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ade9a4-67df-489a-b051-f0fc7f5e8dcf None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:26.720772 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 307/621] 10.222.0.62 () {56 vars in 1137 bytes} [Fri May 27 08:27:26 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 08:27:26.721998 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac48014-b8ac-4a8d-96e2-a3605e264b36 None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:26.783545 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:26.805746 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:26.830797 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ade9a4-67df-489a-b051-f0fc7f5e8dcf None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:26.834383 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac48014-b8ac-4a8d-96e2-a3605e264b36 None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:26.870182 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8be65a-4fe8-4421-b72c-7942dcafca96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:26.870976 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8be65a-4fe8-4421-b72c-7942dcafca96 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:26.871256 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8be65a-4fe8-4421-b72c-7942dcafca96 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:26.871529 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8be65a-4fe8-4421-b72c-7942dcafca96 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:26.873864 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85aef2f-8e64-41cc-9c25-c866279a3625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:26.874540 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85aef2f-8e64-41cc-9c25-c866279a3625 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:26.874824 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85aef2f-8e64-41cc-9c25-c866279a3625 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:26.875105 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85aef2f-8e64-41cc-9c25-c866279a3625 None admin] PATH_INFO: `/v3/users` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:26.876801 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85aef2f-8e64-41cc-9c25-c866279a3625 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:27:26.877037 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85aef2f-8e64-41cc-9c25-c866279a3625 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:26.878493 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85aef2f-8e64-41cc-9c25-c866279a3625 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:26.884420 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8be65a-4fe8-4421-b72c-7942dcafca96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:26.886002 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8be65a-4fe8-4421-b72c-7942dcafca96 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:26.901983 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 308/622] 10.222.0.62 () {56 vars in 1139 bytes} [Fri May 27 08:27:26 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:27:26.901983 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85aef2f-8e64-41cc-9c25-c866279a3625 None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:26.911555 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application [None req-6b8be65a-4fe8-4421-b72c-7942dcafca96 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 08:27:26.911555 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:27:26.911555 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:27:26.911555 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:27:26.911555 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:27:26.911555 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:27:26.911555 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:27:26.911555 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:27:26.911555 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:27:26.911555 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:27:26.911555 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:27:26.911555 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:27:26.911555 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 08:27:26.911555 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 08:27:26.911555 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 08:27:26.912453 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 08:27:26.912453 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:27:26.912453 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:27:26.912453 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:27:26.912453 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:27:26.912453 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:27:26.912453 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:27:26.912453 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:27:26.912453 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application with Lock( May 27 08:27:26.912453 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:27:26.912453 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._enter() May 27 08:27:26.912453 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:27:26.912453 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:27:26.912453 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:27:26.912453 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.creator() May 27 08:27:26.912453 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:27:26.912453 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application created_value = creator( May 27 08:27:26.913429 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 08:27:26.913429 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 08:27:26.913429 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 08:27:26.913429 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application May 27 08:27:26.913429 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 315/623] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 08:27:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 08:27:26.913713 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8be65a-4fe8-4421-b72c-7942dcafca96 None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:27.014414 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85aef2f-8e64-41cc-9c25-c866279a3625 None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:27.028315 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8be65a-4fe8-4421-b72c-7942dcafca96 None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:27.031126 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:27.054680 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dcee7f-8a35-498d-a190-e1296d68c7d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:27.055327 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dcee7f-8a35-498d-a190-e1296d68c7d1 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:27.055603 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dcee7f-8a35-498d-a190-e1296d68c7d1 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:27.055878 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dcee7f-8a35-498d-a190-e1296d68c7d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:27.066525 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018eda71-5a0f-4572-9cad-cf3982a66798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:27.067170 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018eda71-5a0f-4572-9cad-cf3982a66798 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:27.067453 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018eda71-5a0f-4572-9cad-cf3982a66798 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:27.067729 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018eda71-5a0f-4572-9cad-cf3982a66798 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:27.070473 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:27.128326 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dcee7f-8a35-498d-a190-e1296d68c7d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:27.129831 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dcee7f-8a35-498d-a190-e1296d68c7d1 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:27.142717 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018eda71-5a0f-4572-9cad-cf3982a66798 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:27.144172 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018eda71-5a0f-4572-9cad-cf3982a66798 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:27.238918 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 309/624] 10.222.0.62 () {58 vars in 1282 bytes} [Fri May 27 08:27:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 08:27:27.239995 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dcee7f-8a35-498d-a190-e1296d68c7d1 None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:27.256853 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:27.265740 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 316/625] 10.222.0.62 () {58 vars in 1282 bytes} [Fri May 27 08:27:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 08:27:27.271388 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018eda71-5a0f-4572-9cad-cf3982a66798 None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:27.318537 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:27.355238 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dcee7f-8a35-498d-a190-e1296d68c7d1 None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:27.392346 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be210e8-b62a-4859-8a0e-cfb4fec0325e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:27.393041 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be210e8-b62a-4859-8a0e-cfb4fec0325e None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:27.393327 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be210e8-b62a-4859-8a0e-cfb4fec0325e None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:27.393610 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be210e8-b62a-4859-8a0e-cfb4fec0325e None admin] PATH_INFO: `/v3/domains` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:27.394345 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be210e8-b62a-4859-8a0e-cfb4fec0325e None admin] RBAC: Adding query filter params (name=Default) {{(pid=87173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:27:27.394633 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be210e8-b62a-4859-8a0e-cfb4fec0325e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:27.396025 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be210e8-b62a-4859-8a0e-cfb4fec0325e None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:27.401084 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018eda71-5a0f-4572-9cad-cf3982a66798 None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:27.412491 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 310/626] 10.222.0.62 () {56 vars in 1109 bytes} [Fri May 27 08:27:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:27:27.412491 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be210e8-b62a-4859-8a0e-cfb4fec0325e None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:27.443546 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b869ddf8-6ab4-42c7-b961-ffe60f5c9676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:27.444635 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b869ddf8-6ab4-42c7-b961-ffe60f5c9676 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:27.445082 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b869ddf8-6ab4-42c7-b961-ffe60f5c9676 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:27.445499 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b869ddf8-6ab4-42c7-b961-ffe60f5c9676 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:27.457728 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b869ddf8-6ab4-42c7-b961-ffe60f5c9676 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:27.459645 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b869ddf8-6ab4-42c7-b961-ffe60f5c9676 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:27.482736 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application [None req-b869ddf8-6ab4-42c7-b961-ffe60f5c9676 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 08:27:27.482736 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:27:27.482736 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:27:27.482736 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:27:27.482736 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:27:27.482736 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:27:27.482736 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:27:27.482736 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:27:27.482736 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:27:27.482736 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:27:27.482736 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:27:27.482736 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:27:27.482736 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 08:27:27.482736 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 08:27:27.482736 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 08:27:27.483875 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 08:27:27.483875 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:27:27.483875 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:27:27.483875 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:27:27.483875 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:27:27.483875 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:27:27.483875 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:27:27.483875 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:27:27.483875 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application with Lock( May 27 08:27:27.483875 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:27:27.483875 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._enter() May 27 08:27:27.483875 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:27:27.483875 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:27:27.483875 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:27:27.483875 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.creator() May 27 08:27:27.483875 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:27:27.483875 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application created_value = creator( May 27 08:27:27.485689 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 08:27:27.485689 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 08:27:27.485689 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 08:27:27.485689 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application May 27 08:27:27.485689 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 317/627] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 08:27:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 08:27:27.485689 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b869ddf8-6ab4-42c7-b961-ffe60f5c9676 None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:27.492236 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:27.539642 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be210e8-b62a-4859-8a0e-cfb4fec0325e None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:27.591019 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a4e671-840a-4414-a1e7-58676f4af6f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:27.591757 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a4e671-840a-4414-a1e7-58676f4af6f9 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:27.592042 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a4e671-840a-4414-a1e7-58676f4af6f9 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:27.592319 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a4e671-840a-4414-a1e7-58676f4af6f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:27.594328 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:27.605351 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a4e671-840a-4414-a1e7-58676f4af6f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:27.606863 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a4e671-840a-4414-a1e7-58676f4af6f9 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:27.612256 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b869ddf8-6ab4-42c7-b961-ffe60f5c9676 None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:27.625848 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application [None req-56a4e671-840a-4414-a1e7-58676f4af6f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 08:27:27.625848 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:27:27.625848 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:27:27.625848 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:27:27.625848 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:27:27.625848 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:27:27.625848 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:27:27.625848 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:27:27.625848 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:27:27.625848 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:27:27.625848 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:27:27.625848 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:27:27.625848 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 08:27:27.625848 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 08:27:27.625848 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 08:27:27.626890 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 08:27:27.626890 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:27:27.626890 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:27:27.626890 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:27:27.626890 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:27:27.626890 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:27:27.626890 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:27:27.626890 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:27:27.626890 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application with Lock( May 27 08:27:27.626890 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:27:27.626890 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._enter() May 27 08:27:27.626890 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:27:27.626890 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:27:27.626890 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:27:27.626890 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.creator() May 27 08:27:27.626890 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:27:27.626890 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application created_value = creator( May 27 08:27:27.627781 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 08:27:27.627781 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 08:27:27.627781 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 08:27:27.627781 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application May 27 08:27:27.627781 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 311/628] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 08:27:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 08:27:27.628084 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a4e671-840a-4414-a1e7-58676f4af6f9 None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:27.660440 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaf6a4c-7d86-47ac-9229-345ee68e46df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:27.661864 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaf6a4c-7d86-47ac-9229-345ee68e46df None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:27.662155 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaf6a4c-7d86-47ac-9229-345ee68e46df None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:27.662434 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaf6a4c-7d86-47ac-9229-345ee68e46df None admin] PATH_INFO: `/v3/projects/service` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:27.669685 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaf6a4c-7d86-47ac-9229-345ee68e46df None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:27.671140 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaf6a4c-7d86-47ac-9229-345ee68e46df None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:27.685445 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application [None req-8eaf6a4c-7d86-47ac-9229-345ee68e46df None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 08:27:27.685445 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:27:27.685445 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:27:27.685445 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:27:27.685445 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:27:27.685445 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:27:27.685445 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:27:27.685445 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:27:27.685445 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:27:27.685445 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:27:27.685445 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:27:27.685445 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:27:27.685445 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 08:27:27.685445 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 08:27:27.685445 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 08:27:27.686572 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 08:27:27.686572 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:27:27.686572 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:27:27.686572 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:27:27.686572 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:27:27.686572 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:27:27.686572 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:27:27.686572 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:27:27.686572 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application with Lock( May 27 08:27:27.686572 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:27:27.686572 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._enter() May 27 08:27:27.686572 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:27:27.686572 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:27:27.686572 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:27:27.686572 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.creator() May 27 08:27:27.686572 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:27:27.686572 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application created_value = creator( May 27 08:27:27.692446 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 08:27:27.692446 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 08:27:27.692446 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 08:27:27.692446 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 08:27:27.692446 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 08:27:27.692446 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 08:27:27.692446 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 08:27:27.692446 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application May 27 08:27:27.692446 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 318/629] 10.222.0.62 () {56 vars in 1111 bytes} [Fri May 27 08:27:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 08:27:27.692446 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaf6a4c-7d86-47ac-9229-345ee68e46df None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:27.753882 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a4e671-840a-4414-a1e7-58676f4af6f9 None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:27.783887 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:27.795789 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2d9fa2-d12c-4321-9db6-5408b28f5773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:27.796542 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2d9fa2-d12c-4321-9db6-5408b28f5773 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:27.796940 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2d9fa2-d12c-4321-9db6-5408b28f5773 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:27.797300 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2d9fa2-d12c-4321-9db6-5408b28f5773 None admin] PATH_INFO: `/v3/domains` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:27.798649 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2d9fa2-d12c-4321-9db6-5408b28f5773 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:27:27.799038 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2d9fa2-d12c-4321-9db6-5408b28f5773 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:27.800501 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2d9fa2-d12c-4321-9db6-5408b28f5773 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:27.803003 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaf6a4c-7d86-47ac-9229-345ee68e46df None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:27.814247 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 312/630] 10.222.0.62 () {56 vars in 1109 bytes} [Fri May 27 08:27:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:27:27.815184 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2d9fa2-d12c-4321-9db6-5408b28f5773 None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:27.845383 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e092060-9e01-4a98-b22b-233f219d9254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:27.846251 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e092060-9e01-4a98-b22b-233f219d9254 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:27.846737 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e092060-9e01-4a98-b22b-233f219d9254 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:27.847207 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e092060-9e01-4a98-b22b-233f219d9254 None admin] PATH_INFO: `/v3/domains` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:27.848444 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e092060-9e01-4a98-b22b-233f219d9254 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:27:27.848916 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e092060-9e01-4a98-b22b-233f219d9254 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:27.850713 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e092060-9e01-4a98-b22b-233f219d9254 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:27.867495 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 319/631] 10.222.0.62 () {56 vars in 1109 bytes} [Fri May 27 08:27:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:27:27.868777 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e092060-9e01-4a98-b22b-233f219d9254 None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:27.878562 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:27.924136 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2d9fa2-d12c-4321-9db6-5408b28f5773 None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:27.961133 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eba949-19f0-4318-a3fc-41a47647c32c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:27.961800 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eba949-19f0-4318-a3fc-41a47647c32c None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:27.962087 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eba949-19f0-4318-a3fc-41a47647c32c None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:27.962366 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eba949-19f0-4318-a3fc-41a47647c32c None admin] PATH_INFO: `/v3/projects` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:27.963150 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8eba949-19f0-4318-a3fc-41a47647c32c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:27:27.963463 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8eba949-19f0-4318-a3fc-41a47647c32c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:27.964944 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8eba949-19f0-4318-a3fc-41a47647c32c None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:27.977265 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 313/632] 10.222.0.62 () {56 vars in 1148 bytes} [Fri May 27 08:27:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:27:27.977604 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e092060-9e01-4a98-b22b-233f219d9254 None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:27.978487 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2751dff-6a83-4726-aa83-efe65ded6f7d None None] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:27.978781 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2751dff-6a83-4726-aa83-efe65ded6f7d None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:27.979085 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2751dff-6a83-4726-aa83-efe65ded6f7d None None] PATH_INFO: `/` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:27.980447 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 314/633] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:27:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:27:27.981003 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2751dff-6a83-4726-aa83-efe65ded6f7d None None] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:28.016195 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e714b7e-3cb8-4034-a825-fc4715d77648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:28.017130 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e714b7e-3cb8-4034-a825-fc4715d77648 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:28.017425 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e714b7e-3cb8-4034-a825-fc4715d77648 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:28.017696 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e714b7e-3cb8-4034-a825-fc4715d77648 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:28.024500 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e714b7e-3cb8-4034-a825-fc4715d77648 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:28.025980 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e714b7e-3cb8-4034-a825-fc4715d77648 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:28.029456 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:28.040624 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application [None req-8e714b7e-3cb8-4034-a825-fc4715d77648 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 08:27:28.040624 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:27:28.040624 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:27:28.040624 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:27:28.040624 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:27:28.040624 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:27:28.040624 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:27:28.040624 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:27:28.040624 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:27:28.040624 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:27:28.040624 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:27:28.040624 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:27:28.040624 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 08:27:28.040624 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 08:27:28.040624 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 08:27:28.041879 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 08:27:28.041879 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:27:28.041879 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:27:28.041879 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:27:28.041879 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:27:28.041879 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:27:28.041879 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:27:28.041879 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:27:28.041879 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application with Lock( May 27 08:27:28.041879 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:27:28.041879 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._enter() May 27 08:27:28.041879 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:27:28.041879 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:27:28.041879 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:27:28.041879 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.creator() May 27 08:27:28.041879 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:27:28.041879 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application created_value = creator( May 27 08:27:28.042780 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 08:27:28.042780 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 08:27:28.042780 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 08:27:28.042780 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 08:27:28.042780 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 08:27:28.042780 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 08:27:28.042780 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 08:27:28.042780 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application May 27 08:27:28.042780 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 320/634] 10.222.0.62 () {56 vars in 1111 bytes} [Fri May 27 08:27:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 08:27:28.042780 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e714b7e-3cb8-4034-a825-fc4715d77648 None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:28.095926 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2751dff-6a83-4726-aa83-efe65ded6f7d None None] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:28.116882 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:28.131543 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79f487a-6990-4c85-8fb1-aa443891b2b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:28.132340 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79f487a-6990-4c85-8fb1-aa443891b2b0 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:28.132649 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79f487a-6990-4c85-8fb1-aa443891b2b0 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:28.132934 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79f487a-6990-4c85-8fb1-aa443891b2b0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:28.139846 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79f487a-6990-4c85-8fb1-aa443891b2b0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:28.142002 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79f487a-6990-4c85-8fb1-aa443891b2b0 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:28.153867 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e714b7e-3cb8-4034-a825-fc4715d77648 None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:28.155889 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application [None req-e79f487a-6990-4c85-8fb1-aa443891b2b0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 08:27:28.155889 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:27:28.155889 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:27:28.155889 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:27:28.155889 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:27:28.155889 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:27:28.155889 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:27:28.155889 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:27:28.155889 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:27:28.155889 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:27:28.155889 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:27:28.155889 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:27:28.155889 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 08:27:28.155889 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 08:27:28.155889 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 08:27:28.157140 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 08:27:28.157140 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:27:28.157140 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:27:28.157140 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:27:28.157140 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:27:28.157140 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:27:28.157140 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:27:28.157140 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:27:28.157140 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application with Lock( May 27 08:27:28.157140 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:27:28.157140 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._enter() May 27 08:27:28.157140 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:27:28.157140 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:27:28.157140 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:27:28.157140 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.creator() May 27 08:27:28.157140 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:27:28.157140 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application created_value = creator( May 27 08:27:28.158063 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 08:27:28.158063 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 08:27:28.158063 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 08:27:28.158063 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 08:27:28.158063 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 08:27:28.158063 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 08:27:28.158063 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 08:27:28.158063 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application May 27 08:27:28.158063 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 315/635] 10.222.0.62 () {56 vars in 1111 bytes} [Fri May 27 08:27:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 08:27:28.158560 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69563bae-fa0e-4ee8-ba8e-656baadc76fe None None] REQUEST_METHOD: `POST` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:28.158839 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69563bae-fa0e-4ee8-ba8e-656baadc76fe None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:28.159117 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69563bae-fa0e-4ee8-ba8e-656baadc76fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:28.175378 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.auth.core [None req-69563bae-fa0e-4ee8-ba8e-656baadc76fe None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:27:28.176569 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.fernet_utils [None req-69563bae-fa0e-4ee8-ba8e-656baadc76fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:27:28.191059 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec40453-a0fe-4240-a2c5-7c332c262e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:28.191713 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec40453-a0fe-4240-a2c5-7c332c262e6f None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:28.191999 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec40453-a0fe-4240-a2c5-7c332c262e6f None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:28.192279 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec40453-a0fe-4240-a2c5-7c332c262e6f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:28.193145 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec40453-a0fe-4240-a2c5-7c332c262e6f None admin] RBAC: Adding query filter params (role.id=d15a26a31e9f4cad8e2c934cf892d50d, scope.project.id=256f4731060449f1b80067e51e8bec00, user.id=839e73c51c5243b68335242a0d695842) {{(pid=87172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:27:28.193462 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec40453-a0fe-4240-a2c5-7c332c262e6f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:28.194899 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec40453-a0fe-4240-a2c5-7c332c262e6f None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:28.200792 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 321/636] 10.222.0.62 () {56 vars in 1374 bytes} [Fri May 27 08:27:28 2022] GET /identity/v3/role_assignments?user.id=839e73c51c5243b68335242a0d695842&scope.project.id=256f4731060449f1b80067e51e8bec00&role.id=d15a26a31e9f4cad8e2c934cf892d50d => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:27:28.201588 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec40453-a0fe-4240-a2c5-7c332c262e6f None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:28.256715 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 316/637] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:27:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 08:27:28.256715 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69563bae-fa0e-4ee8-ba8e-656baadc76fe None None] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:28.308365 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:28.331173 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec40453-a0fe-4240-a2c5-7c332c262e6f None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:28.365087 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:28.371938 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb6f162-6573-46d2-9133-6f722e58130f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:28.372738 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb6f162-6573-46d2-9133-6f722e58130f None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:28.373027 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb6f162-6573-46d2-9133-6f722e58130f None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:28.373304 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb6f162-6573-46d2-9133-6f722e58130f None admin] PATH_INFO: `/v3/projects` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:28.374114 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb6f162-6573-46d2-9133-6f722e58130f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:27:28.374421 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb6f162-6573-46d2-9133-6f722e58130f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:28.376643 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb6f162-6573-46d2-9133-6f722e58130f None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:28.390708 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69563bae-fa0e-4ee8-ba8e-656baadc76fe None None] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:28.395149 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 322/638] 10.222.0.62 () {56 vars in 1148 bytes} [Fri May 27 08:27:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:27:28.395539 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb6f162-6573-46d2-9133-6f722e58130f None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:28.437147 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f042f95d-ff77-417e-8edf-7a13d4592105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:28.437821 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f042f95d-ff77-417e-8edf-7a13d4592105 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:28.438173 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f042f95d-ff77-417e-8edf-7a13d4592105 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:28.439015 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f042f95d-ff77-417e-8edf-7a13d4592105 None admin] PATH_INFO: `/v3/projects` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:28.441367 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f042f95d-ff77-417e-8edf-7a13d4592105 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:27:28.441367 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f042f95d-ff77-417e-8edf-7a13d4592105 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:28.441639 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f042f95d-ff77-417e-8edf-7a13d4592105 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:28.453743 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 317/639] 10.222.0.62 () {56 vars in 1148 bytes} [Fri May 27 08:27:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:27:28.454593 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f042f95d-ff77-417e-8edf-7a13d4592105 None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:28.523440 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb6f162-6573-46d2-9133-6f722e58130f None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:28.561042 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:28.563277 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276a5f30-befd-410d-bdb5-e9fd77a1578b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:28.563986 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276a5f30-befd-410d-bdb5-e9fd77a1578b None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:28.564277 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276a5f30-befd-410d-bdb5-e9fd77a1578b None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:28.564561 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276a5f30-befd-410d-bdb5-e9fd77a1578b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:28.569802 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f042f95d-ff77-417e-8edf-7a13d4592105 None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:28.575777 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276a5f30-befd-410d-bdb5-e9fd77a1578b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 08:27:28.584097 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application [None req-276a5f30-befd-410d-bdb5-e9fd77a1578b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 08:27:28.584097 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:27:28.584097 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:27:28.584097 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:27:28.584097 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:27:28.584097 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:27:28.584097 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:27:28.584097 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:27:28.584097 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:27:28.584097 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:27:28.584097 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:27:28.584097 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:27:28.584097 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 08:27:28.584097 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 08:27:28.584097 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 08:27:28.584097 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 08:27:28.585373 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 08:27:28.585373 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 08:27:28.585373 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 08:27:28.585373 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 08:27:28.585373 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:27:28.585373 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:27:28.585373 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:27:28.585373 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:27:28.585373 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:27:28.585373 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:27:28.585373 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:27:28.585373 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application with Lock( May 27 08:27:28.585373 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:27:28.585373 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._enter() May 27 08:27:28.585373 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:27:28.585373 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:27:28.586593 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:27:28.586593 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.creator() May 27 08:27:28.586593 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:27:28.586593 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application created_value = creator( May 27 08:27:28.586593 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 08:27:28.586593 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 08:27:28.586593 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 08:27:28.586593 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 08:27:28.586593 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 08:27:28.586593 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 08:27:28.586593 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 08:27:28.586593 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application May 27 08:27:28.586593 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 323/640] 10.222.0.62 () {56 vars in 1096 bytes} [Fri May 27 08:27:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 08:27:28.586593 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276a5f30-befd-410d-bdb5-e9fd77a1578b None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:28.616288 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643a6cba-85b1-48e8-a923-07c8370d680c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:28.617009 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643a6cba-85b1-48e8-a923-07c8370d680c None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:28.617306 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643a6cba-85b1-48e8-a923-07c8370d680c None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:28.617588 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643a6cba-85b1-48e8-a923-07c8370d680c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:28.618434 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643a6cba-85b1-48e8-a923-07c8370d680c None admin] RBAC: Adding query filter params (role.id=d15a26a31e9f4cad8e2c934cf892d50d, scope.project.id=256f4731060449f1b80067e51e8bec00, user.id=2af5ebcf47654d08881584431b199416) {{(pid=87173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:27:28.618746 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643a6cba-85b1-48e8-a923-07c8370d680c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:28.620201 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643a6cba-85b1-48e8-a923-07c8370d680c None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:28.627873 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 318/641] 10.222.0.62 () {56 vars in 1374 bytes} [Fri May 27 08:27:28 2022] GET /identity/v3/role_assignments?user.id=2af5ebcf47654d08881584431b199416&scope.project.id=256f4731060449f1b80067e51e8bec00&role.id=d15a26a31e9f4cad8e2c934cf892d50d => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:27:28.628727 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643a6cba-85b1-48e8-a923-07c8370d680c None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:28.658559 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:28.725795 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276a5f30-befd-410d-bdb5-e9fd77a1578b None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:28.768649 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7504de-1aaa-44b7-a002-24c63a02ff16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:28.769418 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7504de-1aaa-44b7-a002-24c63a02ff16 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:28.769853 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7504de-1aaa-44b7-a002-24c63a02ff16 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:28.770218 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7504de-1aaa-44b7-a002-24c63a02ff16 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:28.771150 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7504de-1aaa-44b7-a002-24c63a02ff16 None admin] RBAC: Adding query filter params (role.id=d15a26a31e9f4cad8e2c934cf892d50d, scope.project.id=256f4731060449f1b80067e51e8bec00, user.id=56934ba9afb741679e0573167d6825f5) {{(pid=87172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:27:28.771565 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7504de-1aaa-44b7-a002-24c63a02ff16 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:28.773254 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7504de-1aaa-44b7-a002-24c63a02ff16 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:28.784900 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 324/642] 10.222.0.62 () {56 vars in 1374 bytes} [Fri May 27 08:27:28 2022] GET /identity/v3/role_assignments?user.id=56934ba9afb741679e0573167d6825f5&scope.project.id=256f4731060449f1b80067e51e8bec00&role.id=d15a26a31e9f4cad8e2c934cf892d50d => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:27:28.794505 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643a6cba-85b1-48e8-a923-07c8370d680c None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:28.838861 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7144a964-60a0-48b2-adad-0707f50e080b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:28.839555 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7144a964-60a0-48b2-adad-0707f50e080b None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:28.839836 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7144a964-60a0-48b2-adad-0707f50e080b None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:28.840109 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7144a964-60a0-48b2-adad-0707f50e080b None admin] PATH_INFO: `/v3/roles` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:28.840909 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7144a964-60a0-48b2-adad-0707f50e080b None admin] RBAC: Adding query filter params (name=admin) {{(pid=87173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:27:28.841214 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7144a964-60a0-48b2-adad-0707f50e080b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:28.842651 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7144a964-60a0-48b2-adad-0707f50e080b None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:28.853889 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 319/643] 10.222.0.62 () {56 vars in 1099 bytes} [Fri May 27 08:27:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:27:28.859254 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7504de-1aaa-44b7-a002-24c63a02ff16 None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:28.988584 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7504de-1aaa-44b7-a002-24c63a02ff16 None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:29.005092 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:29.029234 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332a9be2-2dd3-4037-8e62-47a4d02b5f98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:29.030044 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332a9be2-2dd3-4037-8e62-47a4d02b5f98 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:29.030329 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332a9be2-2dd3-4037-8e62-47a4d02b5f98 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:29.030609 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332a9be2-2dd3-4037-8e62-47a4d02b5f98 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:29.043117 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332a9be2-2dd3-4037-8e62-47a4d02b5f98 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:29.044467 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332a9be2-2dd3-4037-8e62-47a4d02b5f98 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:29.063174 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application [None req-332a9be2-2dd3-4037-8e62-47a4d02b5f98 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 08:27:29.063174 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:27:29.063174 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:27:29.063174 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:27:29.063174 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:27:29.063174 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:27:29.063174 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:27:29.063174 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:27:29.063174 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:27:29.063174 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:27:29.063174 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:27:29.063174 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:27:29.063174 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 08:27:29.063174 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 08:27:29.063174 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 08:27:29.064197 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 08:27:29.064197 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:27:29.064197 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:27:29.064197 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:27:29.064197 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:27:29.064197 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:27:29.064197 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:27:29.064197 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:27:29.064197 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application with Lock( May 27 08:27:29.064197 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:27:29.064197 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._enter() May 27 08:27:29.064197 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:27:29.064197 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:27:29.064197 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:27:29.064197 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.creator() May 27 08:27:29.064197 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:27:29.064197 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application created_value = creator( May 27 08:27:29.065171 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 08:27:29.065171 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 08:27:29.065171 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 08:27:29.065171 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application May 27 08:27:29.065171 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 325/644] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 08:27:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 08:27:29.069836 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7144a964-60a0-48b2-adad-0707f50e080b None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:29.094184 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:29.180566 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7144a964-60a0-48b2-adad-0707f50e080b None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:29.216409 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e064f5-2fc6-423c-890d-60a36ab1b77e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:29.217119 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e064f5-2fc6-423c-890d-60a36ab1b77e None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:29.217393 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e064f5-2fc6-423c-890d-60a36ab1b77e None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:29.217675 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e064f5-2fc6-423c-890d-60a36ab1b77e None admin] PATH_INFO: `/v3/domains` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:29.218402 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e064f5-2fc6-423c-890d-60a36ab1b77e None admin] RBAC: Adding query filter params (name=Default) {{(pid=87173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:27:29.218711 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e064f5-2fc6-423c-890d-60a36ab1b77e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:29.220295 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e064f5-2fc6-423c-890d-60a36ab1b77e None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:29.242114 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 320/645] 10.222.0.62 () {56 vars in 1109 bytes} [Fri May 27 08:27:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 08:27:29.247132 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332a9be2-2dd3-4037-8e62-47a4d02b5f98 None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:29.361904 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332a9be2-2dd3-4037-8e62-47a4d02b5f98 None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:29.398166 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f500757a-d899-4440-a336-b51d48775c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:29.399039 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f500757a-d899-4440-a336-b51d48775c12 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:29.399333 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f500757a-d899-4440-a336-b51d48775c12 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:29.399614 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f500757a-d899-4440-a336-b51d48775c12 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:29.408389 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f500757a-d899-4440-a336-b51d48775c12 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:29.409886 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f500757a-d899-4440-a336-b51d48775c12 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:29.427066 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application [None req-f500757a-d899-4440-a336-b51d48775c12 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 27 08:27:29.427066 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:27:29.427066 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:27:29.427066 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:27:29.427066 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:27:29.427066 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:27:29.427066 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:27:29.427066 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:27:29.427066 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:27:29.427066 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:27:29.427066 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:27:29.427066 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:27:29.427066 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 08:27:29.427066 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 08:27:29.427066 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 08:27:29.427066 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 08:27:29.428035 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:27:29.428035 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:27:29.428035 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 08:27:29.428035 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 08:27:29.428035 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 08:27:29.428035 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 08:27:29.428035 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:27:29.428035 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:27:29.428035 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:27:29.428035 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:27:29.428035 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:27:29.428035 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application with Lock( May 27 08:27:29.428035 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:27:29.428035 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._enter() May 27 08:27:29.428035 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:27:29.428035 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:27:29.428035 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:27:29.428035 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.creator() May 27 08:27:29.429013 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:27:29.429013 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application created_value = creator( May 27 08:27:29.429013 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 08:27:29.429013 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 08:27:29.429013 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 08:27:29.429013 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 08:27:29.429013 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 08:27:29.429013 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 08:27:29.429013 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 27 08:27:29.429013 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application May 27 08:27:29.429013 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 326/646] 10.222.0.62 () {56 vars in 1093 bytes} [Fri May 27 08:27:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 08:27:29.433802 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e064f5-2fc6-423c-890d-60a36ab1b77e None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:29.527465 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:29.548702 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e064f5-2fc6-423c-890d-60a36ab1b77e None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:29.585547 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97e990d-6f5c-436b-9f39-b7855cad8472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:29.586259 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97e990d-6f5c-436b-9f39-b7855cad8472 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:29.586549 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97e990d-6f5c-436b-9f39-b7855cad8472 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:29.586826 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97e990d-6f5c-436b-9f39-b7855cad8472 None admin] PATH_INFO: `/v3/users` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:29.587661 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97e990d-6f5c-436b-9f39-b7855cad8472 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:27:29.587969 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97e990d-6f5c-436b-9f39-b7855cad8472 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:29.589458 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97e990d-6f5c-436b-9f39-b7855cad8472 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:29.609769 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 321/647] 10.222.0.62 () {56 vars in 1133 bytes} [Fri May 27 08:27:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 08:27:29.616316 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f500757a-d899-4440-a336-b51d48775c12 None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:29.665464 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:29.744196 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f500757a-d899-4440-a336-b51d48775c12 None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:29.780893 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2b7b9f-9ed5-4d45-bfc9-bcf5248eaf05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:29.782390 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2b7b9f-9ed5-4d45-bfc9-bcf5248eaf05 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:29.782856 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2b7b9f-9ed5-4d45-bfc9-bcf5248eaf05 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:29.783337 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2b7b9f-9ed5-4d45-bfc9-bcf5248eaf05 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:29.855032 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2b7b9f-9ed5-4d45-bfc9-bcf5248eaf05 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:29.856806 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2b7b9f-9ed5-4d45-bfc9-bcf5248eaf05 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:29.885776 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:29.969030 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 327/648] 10.222.0.62 () {58 vars in 1282 bytes} [Fri May 27 08:27:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 27 08:27:29.971133 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97e990d-6f5c-436b-9f39-b7855cad8472 None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:30.085823 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97e990d-6f5c-436b-9f39-b7855cad8472 None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:30.125142 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe0df9a-32f7-4a5c-a724-01638e52f586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:30.126534 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe0df9a-32f7-4a5c-a724-01638e52f586 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:30.127005 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe0df9a-32f7-4a5c-a724-01638e52f586 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:30.127490 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe0df9a-32f7-4a5c-a724-01638e52f586 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:30.134739 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:30.139260 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe0df9a-32f7-4a5c-a724-01638e52f586 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:30.141009 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe0df9a-32f7-4a5c-a724-01638e52f586 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:30.160365 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application [None req-6fe0df9a-32f7-4a5c-a724-01638e52f586 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 08:27:30.160365 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:27:30.160365 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:27:30.160365 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:27:30.160365 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:27:30.160365 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:27:30.160365 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:27:30.160365 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:27:30.160365 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:27:30.160365 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:27:30.160365 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:27:30.160365 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:27:30.160365 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 08:27:30.160365 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 08:27:30.160365 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 08:27:30.161610 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 08:27:30.161610 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:27:30.161610 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:27:30.161610 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:27:30.161610 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:27:30.161610 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:27:30.161610 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:27:30.161610 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:27:30.161610 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application with Lock( May 27 08:27:30.161610 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:27:30.161610 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._enter() May 27 08:27:30.161610 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:27:30.161610 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:27:30.161610 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:27:30.161610 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.creator() May 27 08:27:30.161610 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:27:30.161610 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application created_value = creator( May 27 08:27:30.162518 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 08:27:30.162518 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 08:27:30.162518 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 08:27:30.162518 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application May 27 08:27:30.164510 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 322/649] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 08:27:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 08:27:30.170294 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2b7b9f-9ed5-4d45-bfc9-bcf5248eaf05 None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:30.275900 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2b7b9f-9ed5-4d45-bfc9-bcf5248eaf05 None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:30.303350 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:30.311904 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed0455d-a5c7-4267-92bb-af0e6d031e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:30.312577 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed0455d-a5c7-4267-92bb-af0e6d031e7e None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:30.313128 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed0455d-a5c7-4267-92bb-af0e6d031e7e None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:30.313409 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed0455d-a5c7-4267-92bb-af0e6d031e7e None admin] PATH_INFO: `/v3/domains` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:30.314399 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed0455d-a5c7-4267-92bb-af0e6d031e7e None admin] RBAC: Adding query filter params (name=Default) {{(pid=87172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:27:30.315113 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed0455d-a5c7-4267-92bb-af0e6d031e7e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:30.316847 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed0455d-a5c7-4267-92bb-af0e6d031e7e None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:30.330372 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 328/650] 10.222.0.62 () {56 vars in 1109 bytes} [Fri May 27 08:27:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:27:30.335904 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe0df9a-32f7-4a5c-a724-01638e52f586 None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:30.445426 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe0df9a-32f7-4a5c-a724-01638e52f586 None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:30.481295 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b69a9ad-ef56-4580-b791-f93a013befe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:30.482120 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b69a9ad-ef56-4580-b791-f93a013befe3 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:30.482405 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b69a9ad-ef56-4580-b791-f93a013befe3 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:30.482682 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b69a9ad-ef56-4580-b791-f93a013befe3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:30.491294 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b69a9ad-ef56-4580-b791-f93a013befe3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:30.492856 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b69a9ad-ef56-4580-b791-f93a013befe3 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:30.509052 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application [None req-1b69a9ad-ef56-4580-b791-f93a013befe3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 08:27:30.509052 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:27:30.509052 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:27:30.509052 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:27:30.509052 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:27:30.509052 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:27:30.509052 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:27:30.509052 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:27:30.509052 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:27:30.509052 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:27:30.509052 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:27:30.509052 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:27:30.509052 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 08:27:30.509052 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 08:27:30.509052 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 08:27:30.510021 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 08:27:30.510021 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:27:30.510021 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:27:30.510021 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:27:30.510021 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:27:30.510021 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:27:30.510021 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:27:30.510021 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:27:30.510021 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application with Lock( May 27 08:27:30.510021 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:27:30.510021 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._enter() May 27 08:27:30.510021 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:27:30.510021 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:27:30.510021 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:27:30.510021 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.creator() May 27 08:27:30.510021 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:27:30.510021 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application created_value = creator( May 27 08:27:30.511369 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 08:27:30.511369 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 08:27:30.511369 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 08:27:30.511369 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 08:27:30.511369 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 08:27:30.511369 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 08:27:30.511369 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 08:27:30.511369 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application May 27 08:27:30.511369 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 323/651] 10.222.0.62 () {56 vars in 1111 bytes} [Fri May 27 08:27:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 08:27:30.517215 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed0455d-a5c7-4267-92bb-af0e6d031e7e None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:30.622964 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed0455d-a5c7-4267-92bb-af0e6d031e7e None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:30.662310 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71d9442-25c8-46d5-9abd-64731e60eb59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:30.662992 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71d9442-25c8-46d5-9abd-64731e60eb59 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:30.663282 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71d9442-25c8-46d5-9abd-64731e60eb59 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:30.663561 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71d9442-25c8-46d5-9abd-64731e60eb59 None admin] PATH_INFO: `/v3/projects` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:30.664366 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71d9442-25c8-46d5-9abd-64731e60eb59 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:27:30.664717 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71d9442-25c8-46d5-9abd-64731e60eb59 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:30.666354 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71d9442-25c8-46d5-9abd-64731e60eb59 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:30.679750 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 329/652] 10.222.0.62 () {56 vars in 1148 bytes} [Fri May 27 08:27:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:27:30.685927 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b69a9ad-ef56-4580-b791-f93a013befe3 None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:30.710087 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a005872-93d2-4034-b1f1-4a64615bc821 None None] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:30.710433 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a005872-93d2-4034-b1f1-4a64615bc821 None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:30.710657 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a005872-93d2-4034-b1f1-4a64615bc821 None None] PATH_INFO: `/` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:30.712275 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 330/653] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:27:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 08:27:30.717360 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5547b432-6d11-4877-a48e-fa99fc7a1f37 None None] REQUEST_METHOD: `POST` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:30.717646 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5547b432-6d11-4877-a48e-fa99fc7a1f37 None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:30.717925 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5547b432-6d11-4877-a48e-fa99fc7a1f37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:30.736240 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.auth.core [None req-5547b432-6d11-4877-a48e-fa99fc7a1f37 None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:27:30.737458 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.fernet_utils [None req-5547b432-6d11-4877-a48e-fa99fc7a1f37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:27:30.761047 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:30.789210 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:30.813806 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b69a9ad-ef56-4580-b791-f93a013befe3 None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:30.821031 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 331/654] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:27:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 08:27:30.842013 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5547b432-6d11-4877-a48e-fa99fc7a1f37 None None] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:30.851558 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde91a70-6796-4025-995a-47d7d2575b12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:30.852220 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde91a70-6796-4025-995a-47d7d2575b12 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:30.852507 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde91a70-6796-4025-995a-47d7d2575b12 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:30.852810 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde91a70-6796-4025-995a-47d7d2575b12 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:30.854008 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde91a70-6796-4025-995a-47d7d2575b12 None admin] RBAC: Adding query filter params (role.id=5e6f243a7201412c965e7c70249d4dc0, scope.project.id=256f4731060449f1b80067e51e8bec00, user.id=3a09bdc2dbac4f9abe450ff121e7dce8) {{(pid=87173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:27:30.854321 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde91a70-6796-4025-995a-47d7d2575b12 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:30.856380 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde91a70-6796-4025-995a-47d7d2575b12 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:30.865180 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 324/655] 10.222.0.62 () {56 vars in 1374 bytes} [Fri May 27 08:27:30 2022] GET /identity/v3/role_assignments?user.id=3a09bdc2dbac4f9abe450ff121e7dce8&scope.project.id=256f4731060449f1b80067e51e8bec00&role.id=5e6f243a7201412c965e7c70249d4dc0 => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:27:30.973207 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5547b432-6d11-4877-a48e-fa99fc7a1f37 None None] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:31.014397 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fb8a03-3b1a-4d37-831c-d4bede4aa62e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:31.015232 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fb8a03-3b1a-4d37-831c-d4bede4aa62e None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:31.015517 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fb8a03-3b1a-4d37-831c-d4bede4aa62e None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:31.015796 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fb8a03-3b1a-4d37-831c-d4bede4aa62e None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:31.016539 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fb8a03-3b1a-4d37-831c-d4bede4aa62e None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:31.018006 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fb8a03-3b1a-4d37-831c-d4bede4aa62e None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:31.033814 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application [None req-d9fb8a03-3b1a-4d37-831c-d4bede4aa62e None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 27 08:27:31.033814 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:27:31.033814 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 08:27:31.033814 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 08:27:31.033814 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 08:27:31.033814 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 08:27:31.033814 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 08:27:31.033814 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 08:27:31.033814 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 27 08:27:31.033814 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application May 27 08:27:31.033814 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 08:27:31.033814 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application May 27 08:27:31.033814 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:27:31.033814 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:27:31.033814 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:27:31.033814 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:27:31.035057 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:27:31.035057 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:27:31.035057 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:27:31.035057 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:27:31.035057 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:27:31.035057 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:27:31.035057 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:27:31.035057 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 08:27:31.035057 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 08:27:31.035057 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 08:27:31.035057 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 08:27:31.035057 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:27:31.035057 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:27:31.035057 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:27:31.035057 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:27:31.035057 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:27:31.036607 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:27:31.036607 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:27:31.036607 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application with Lock( May 27 08:27:31.036607 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:27:31.036607 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._enter() May 27 08:27:31.036607 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:27:31.036607 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:27:31.036607 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:27:31.036607 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.creator() May 27 08:27:31.036607 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:27:31.036607 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application created_value = creator( May 27 08:27:31.036607 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 08:27:31.036607 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 08:27:31.036607 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 27 08:27:31.036607 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application May 27 08:27:31.036607 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 332/656] 10.222.0.62 () {56 vars in 1129 bytes} [Fri May 27 08:27:30 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 08:27:31.043550 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde91a70-6796-4025-995a-47d7d2575b12 None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:31.174196 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde91a70-6796-4025-995a-47d7d2575b12 None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:31.178157 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9b5601-b150-45d8-84a5-5e9fe232b19a None None] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:31.178640 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9b5601-b150-45d8-84a5-5e9fe232b19a None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:31.178933 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9b5601-b150-45d8-84a5-5e9fe232b19a None None] PATH_INFO: `/` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:31.180826 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 333/657] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:27:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:27:31.187011 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78162257-f3cb-476e-8a8b-201491bb017e None None] REQUEST_METHOD: `POST` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:31.187447 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78162257-f3cb-476e-8a8b-201491bb017e None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:31.188648 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78162257-f3cb-476e-8a8b-201491bb017e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:31.191814 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:31.213978 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.auth.core [None req-78162257-f3cb-476e-8a8b-201491bb017e None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:27:31.214506 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924610c9-8459-4d9d-a73d-b364fce84c99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:31.215175 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924610c9-8459-4d9d-a73d-b364fce84c99 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:31.215456 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924610c9-8459-4d9d-a73d-b364fce84c99 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:31.215627 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.fernet_utils [None req-78162257-f3cb-476e-8a8b-201491bb017e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:27:31.215769 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924610c9-8459-4d9d-a73d-b364fce84c99 None admin] PATH_INFO: `/v3/services` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:31.216431 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924610c9-8459-4d9d-a73d-b364fce84c99 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:27:31.216774 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924610c9-8459-4d9d-a73d-b364fce84c99 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:31.218156 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924610c9-8459-4d9d-a73d-b364fce84c99 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:31.224616 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 325/658] 10.222.0.62 () {56 vars in 1124 bytes} [Fri May 27 08:27:31 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:27:31.229901 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924610c9-8459-4d9d-a73d-b364fce84c99 None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:31.276964 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:31.310566 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 334/659] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:27:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 08:27:31.337844 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78162257-f3cb-476e-8a8b-201491bb017e None None] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:31.341635 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924610c9-8459-4d9d-a73d-b364fce84c99 None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:31.379934 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91f9734-cb63-48bc-b368-3e5007ff26e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:31.380635 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91f9734-cb63-48bc-b368-3e5007ff26e3 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:31.380926 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91f9734-cb63-48bc-b368-3e5007ff26e3 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:31.381254 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91f9734-cb63-48bc-b368-3e5007ff26e3 None admin] PATH_INFO: `/v3/services` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:31.382037 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91f9734-cb63-48bc-b368-3e5007ff26e3 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:27:31.382390 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91f9734-cb63-48bc-b368-3e5007ff26e3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:31.383788 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91f9734-cb63-48bc-b368-3e5007ff26e3 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:31.390250 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 326/660] 10.222.0.62 () {56 vars in 1124 bytes} [Fri May 27 08:27:31 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 08:27:31.392409 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8508229-3b64-490f-a7b9-96fbdfc3a7de None None] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:31.392709 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8508229-3b64-490f-a7b9-96fbdfc3a7de None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:31.392978 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8508229-3b64-490f-a7b9-96fbdfc3a7de None None] PATH_INFO: `/` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:31.394688 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 327/661] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:27:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:27:31.400305 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b45d68-a30d-411c-a771-20d6bc246f28 None None] REQUEST_METHOD: `POST` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:31.400729 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b45d68-a30d-411c-a771-20d6bc246f28 None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:31.400904 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b45d68-a30d-411c-a771-20d6bc246f28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:31.420812 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.auth.core [None req-36b45d68-a30d-411c-a771-20d6bc246f28 None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:27:31.422040 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.fernet_utils [None req-36b45d68-a30d-411c-a771-20d6bc246f28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:27:31.467495 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:31.494316 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78162257-f3cb-476e-8a8b-201491bb017e None None] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:31.517363 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 328/662] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:27:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 08:27:31.539299 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b45d68-a30d-411c-a771-20d6bc246f28 None None] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:31.541147 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4538f5-52d8-4917-b0b9-9be957a5670a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:31.543648 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4538f5-52d8-4917-b0b9-9be957a5670a None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:31.544134 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4538f5-52d8-4917-b0b9-9be957a5670a None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:31.544563 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4538f5-52d8-4917-b0b9-9be957a5670a None admin] PATH_INFO: `/v3/services/image` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:31.545487 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4538f5-52d8-4917-b0b9-9be957a5670a None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:31.547072 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4538f5-52d8-4917-b0b9-9be957a5670a None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:31.564578 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application [None req-6b4538f5-52d8-4917-b0b9-9be957a5670a None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 27 08:27:31.564578 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:27:31.564578 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 08:27:31.564578 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 08:27:31.564578 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 08:27:31.564578 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 08:27:31.564578 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 08:27:31.564578 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 08:27:31.564578 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 27 08:27:31.564578 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application May 27 08:27:31.564578 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 08:27:31.564578 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application May 27 08:27:31.564578 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:27:31.564578 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:27:31.564578 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:27:31.564578 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:27:31.564578 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:27:31.565899 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:27:31.565899 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:27:31.565899 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:27:31.565899 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:27:31.565899 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:27:31.565899 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:27:31.565899 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 08:27:31.565899 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 08:27:31.565899 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 08:27:31.565899 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 08:27:31.565899 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:27:31.565899 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:27:31.565899 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:27:31.565899 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:27:31.565899 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:27:31.565899 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:27:31.566803 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:27:31.566803 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application with Lock( May 27 08:27:31.566803 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:27:31.566803 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._enter() May 27 08:27:31.566803 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:27:31.566803 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:27:31.566803 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:27:31.566803 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.creator() May 27 08:27:31.566803 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:27:31.566803 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application created_value = creator( May 27 08:27:31.566803 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 08:27:31.566803 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 08:27:31.566803 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 27 08:27:31.566803 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application May 27 08:27:31.576739 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 335/663] 10.222.0.62 () {56 vars in 1105 bytes} [Fri May 27 08:27:31 2022] GET /identity/v3/services/image => generated 86 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 08:27:31.580180 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4538f5-52d8-4917-b0b9-9be957a5670a None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:31.638861 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:31.709008 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b45d68-a30d-411c-a771-20d6bc246f28 None None] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:31.740666 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4538f5-52d8-4917-b0b9-9be957a5670a None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:31.752105 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecf23f7-0f52-4720-a970-da094b6b28b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:31.753060 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecf23f7-0f52-4720-a970-da094b6b28b6 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:31.753416 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecf23f7-0f52-4720-a970-da094b6b28b6 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:31.753796 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecf23f7-0f52-4720-a970-da094b6b28b6 None admin] PATH_INFO: `/v3/services/network` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:31.754544 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecf23f7-0f52-4720-a970-da094b6b28b6 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:31.756274 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecf23f7-0f52-4720-a970-da094b6b28b6 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:31.771861 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application [None req-3ecf23f7-0f52-4720-a970-da094b6b28b6 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 27 08:27:31.771861 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:27:31.771861 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 08:27:31.771861 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 08:27:31.771861 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 08:27:31.771861 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 08:27:31.771861 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 08:27:31.771861 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 08:27:31.771861 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 27 08:27:31.771861 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application May 27 08:27:31.771861 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 08:27:31.771861 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application May 27 08:27:31.771861 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:27:31.771861 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:27:31.771861 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:27:31.771861 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:27:31.771861 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:27:31.772953 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:27:31.772953 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:27:31.772953 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:27:31.772953 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:27:31.772953 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:27:31.772953 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:27:31.772953 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 08:27:31.772953 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 08:27:31.772953 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 08:27:31.772953 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 08:27:31.772953 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:27:31.772953 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:27:31.772953 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:27:31.772953 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:27:31.772953 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:27:31.772953 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:27:31.773779 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:27:31.773779 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application with Lock( May 27 08:27:31.773779 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:27:31.773779 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._enter() May 27 08:27:31.773779 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:27:31.773779 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:27:31.773779 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:27:31.773779 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.creator() May 27 08:27:31.773779 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:27:31.773779 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application created_value = creator( May 27 08:27:31.773779 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 08:27:31.773779 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 08:27:31.773779 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 27 08:27:31.773779 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application May 27 08:27:31.773779 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 329/664] 10.222.0.62 () {56 vars in 1111 bytes} [Fri May 27 08:27:31 2022] GET /identity/v3/services/network => generated 88 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 08:27:31.782761 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecf23f7-0f52-4720-a970-da094b6b28b6 None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:31.792421 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3672de9e-8ba8-4075-a240-69d84e37c8a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:31.793375 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3672de9e-8ba8-4075-a240-69d84e37c8a1 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:31.793808 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3672de9e-8ba8-4075-a240-69d84e37c8a1 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:31.794259 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3672de9e-8ba8-4075-a240-69d84e37c8a1 None admin] PATH_INFO: `/v3/services` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:31.795135 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3672de9e-8ba8-4075-a240-69d84e37c8a1 None admin] RBAC: Adding query filter params (name=image) {{(pid=87172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:27:31.795589 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3672de9e-8ba8-4075-a240-69d84e37c8a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:31.798842 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3672de9e-8ba8-4075-a240-69d84e37c8a1 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:31.806495 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 336/665] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 08:27:31 2022] GET /identity/v3/services?name=image => generated 122 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:27:31.811537 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3672de9e-8ba8-4075-a240-69d84e37c8a1 None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:31.831407 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:31.906138 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecf23f7-0f52-4720-a970-da094b6b28b6 None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:31.924034 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:31.928642 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3672de9e-8ba8-4075-a240-69d84e37c8a1 None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:31.947560 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337daea1-233b-4663-bf1f-72e0d672ce1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:31.948503 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337daea1-233b-4663-bf1f-72e0d672ce1a None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:31.948820 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337daea1-233b-4663-bf1f-72e0d672ce1a None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:31.949103 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337daea1-233b-4663-bf1f-72e0d672ce1a None admin] PATH_INFO: `/v3/services` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:31.949931 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337daea1-233b-4663-bf1f-72e0d672ce1a None admin] RBAC: Adding query filter params (name=network) {{(pid=87173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:27:31.950247 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337daea1-233b-4663-bf1f-72e0d672ce1a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:31.951820 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337daea1-233b-4663-bf1f-72e0d672ce1a None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:31.957208 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 330/666] 10.222.0.62 () {56 vars in 1112 bytes} [Fri May 27 08:27:31 2022] GET /identity/v3/services?name=network => generated 124 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 08:27:31.968612 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337daea1-233b-4663-bf1f-72e0d672ce1a None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:31.978282 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed828efe-b44b-4f7f-b505-9a118661c603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:31.979110 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed828efe-b44b-4f7f-b505-9a118661c603 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:31.979399 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed828efe-b44b-4f7f-b505-9a118661c603 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:31.980053 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed828efe-b44b-4f7f-b505-9a118661c603 None admin] PATH_INFO: `/v3/services` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:31.981099 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed828efe-b44b-4f7f-b505-9a118661c603 None admin] RBAC: Adding query filter params (type=image) {{(pid=87172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:27:31.981409 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed828efe-b44b-4f7f-b505-9a118661c603 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:31.982951 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed828efe-b44b-4f7f-b505-9a118661c603 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:31.990930 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 337/667] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 08:27:31 2022] GET /identity/v3/services?type=image => generated 122 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 08:27:32.085137 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:32.089321 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337daea1-233b-4663-bf1f-72e0d672ce1a None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:32.130073 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162655a6-94d1-4ae7-9657-e43eb200b7dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:32.130759 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162655a6-94d1-4ae7-9657-e43eb200b7dc None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:32.131043 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162655a6-94d1-4ae7-9657-e43eb200b7dc None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:32.131322 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162655a6-94d1-4ae7-9657-e43eb200b7dc None admin] PATH_INFO: `/v3/services` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:32.132049 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162655a6-94d1-4ae7-9657-e43eb200b7dc None admin] RBAC: Adding query filter params (type=network) {{(pid=87173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:27:32.132357 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162655a6-94d1-4ae7-9657-e43eb200b7dc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:32.133826 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162655a6-94d1-4ae7-9657-e43eb200b7dc None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:32.139553 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 331/668] 10.222.0.62 () {56 vars in 1112 bytes} [Fri May 27 08:27:31 2022] GET /identity/v3/services?type=network => generated 124 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 08:27:33.291455 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b099d8-2930-4ca7-a7e5-67a4dff2948b None None] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:33.291974 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b099d8-2930-4ca7-a7e5-67a4dff2948b None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:33.292050 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b099d8-2930-4ca7-a7e5-67a4dff2948b None None] PATH_INFO: `/` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:33.293651 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 338/669] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:27:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:27:33.299328 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49910e84-8952-48c2-9ecf-a29f83d5ed21 None None] REQUEST_METHOD: `POST` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:33.299782 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49910e84-8952-48c2-9ecf-a29f83d5ed21 None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:33.299966 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49910e84-8952-48c2-9ecf-a29f83d5ed21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:33.319709 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.auth.core [None req-49910e84-8952-48c2-9ecf-a29f83d5ed21 None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:27:33.320975 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.fernet_utils [None req-49910e84-8952-48c2-9ecf-a29f83d5ed21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:27:33.393759 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 332/670] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:27:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 08:27:33.417933 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b099d8-2930-4ca7-a7e5-67a4dff2948b None None] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:33.534582 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b099d8-2930-4ca7-a7e5-67a4dff2948b None None] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:33.570278 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee177f5-a8dd-43c8-8070-c60e3b5993da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:33.571084 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee177f5-a8dd-43c8-8070-c60e3b5993da None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:33.571367 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee177f5-a8dd-43c8-8070-c60e3b5993da None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:33.571643 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee177f5-a8dd-43c8-8070-c60e3b5993da None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:33.583115 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee177f5-a8dd-43c8-8070-c60e3b5993da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 08:27:33.591064 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application [None req-5ee177f5-a8dd-43c8-8070-c60e3b5993da None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 08:27:33.591064 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:27:33.591064 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:27:33.591064 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:27:33.591064 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:27:33.591064 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:27:33.591064 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:27:33.591064 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:27:33.591064 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:27:33.591064 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:27:33.591064 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:27:33.591064 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:27:33.591064 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 08:27:33.591064 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 08:27:33.591064 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 08:27:33.591064 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 08:27:33.592081 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 08:27:33.592081 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 08:27:33.592081 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 08:27:33.592081 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 08:27:33.592081 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:27:33.592081 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:27:33.592081 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:27:33.592081 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:27:33.592081 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:27:33.592081 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:27:33.592081 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:27:33.592081 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application with Lock( May 27 08:27:33.592081 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:27:33.592081 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._enter() May 27 08:27:33.592081 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:27:33.592081 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:27:33.592988 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:27:33.592988 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.creator() May 27 08:27:33.592988 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:27:33.592988 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application created_value = creator( May 27 08:27:33.592988 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 08:27:33.592988 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 08:27:33.592988 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 08:27:33.592988 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 08:27:33.592988 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 08:27:33.592988 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 08:27:33.592988 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 08:27:33.592988 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application May 27 08:27:33.592988 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 339/671] 10.222.0.62 () {56 vars in 1096 bytes} [Fri May 27 08:27:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 08:27:33.600364 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49910e84-8952-48c2-9ecf-a29f83d5ed21 None None] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:33.716517 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49910e84-8952-48c2-9ecf-a29f83d5ed21 None None] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:33.724859 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:33.762912 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaef7066-42e5-4784-aa3d-e6d1cb4fb88a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:33.763594 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaef7066-42e5-4784-aa3d-e6d1cb4fb88a None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:33.763877 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaef7066-42e5-4784-aa3d-e6d1cb4fb88a None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:33.764154 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaef7066-42e5-4784-aa3d-e6d1cb4fb88a None admin] PATH_INFO: `/v3/roles` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:33.764954 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaef7066-42e5-4784-aa3d-e6d1cb4fb88a None admin] RBAC: Adding query filter params (name=admin) {{(pid=87173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:27:33.765264 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaef7066-42e5-4784-aa3d-e6d1cb4fb88a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:33.767179 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaef7066-42e5-4784-aa3d-e6d1cb4fb88a None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:33.776600 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 333/672] 10.222.0.62 () {56 vars in 1099 bytes} [Fri May 27 08:27:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:27:33.783552 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee177f5-a8dd-43c8-8070-c60e3b5993da None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:33.803136 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bb8073-8ee7-4294-9d35-10be2ed80b0d None None] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:33.803453 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bb8073-8ee7-4294-9d35-10be2ed80b0d None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:33.803733 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bb8073-8ee7-4294-9d35-10be2ed80b0d None None] PATH_INFO: `/` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:33.806009 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 334/673] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:27:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 08:27:33.811957 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e95655-06be-4b2e-ac57-3ce7633d4449 None None] REQUEST_METHOD: `POST` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:33.812254 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e95655-06be-4b2e-ac57-3ce7633d4449 None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:33.812536 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e95655-06be-4b2e-ac57-3ce7633d4449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:33.819070 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:33.835121 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.auth.core [None req-e0e95655-06be-4b2e-ac57-3ce7633d4449 None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:27:33.836334 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.fernet_utils [None req-e0e95655-06be-4b2e-ac57-3ce7633d4449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:27:33.912004 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee177f5-a8dd-43c8-8070-c60e3b5993da None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:33.936684 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 335/674] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:27:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 08:27:33.956070 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10b542a-ff40-46d3-be92-c79d1714dd93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:33.957313 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10b542a-ff40-46d3-be92-c79d1714dd93 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:33.957802 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10b542a-ff40-46d3-be92-c79d1714dd93 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:33.958293 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10b542a-ff40-46d3-be92-c79d1714dd93 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:33.960244 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e95655-06be-4b2e-ac57-3ce7633d4449 None None] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:33.971139 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10b542a-ff40-46d3-be92-c79d1714dd93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:33.972715 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10b542a-ff40-46d3-be92-c79d1714dd93 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:33.990845 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application [None req-b10b542a-ff40-46d3-be92-c79d1714dd93 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 08:27:33.990845 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:27:33.990845 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:27:33.990845 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:27:33.990845 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:27:33.990845 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:27:33.990845 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:27:33.990845 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:27:33.990845 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:27:33.990845 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:27:33.990845 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:27:33.990845 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:27:33.990845 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 08:27:33.990845 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 08:27:33.990845 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 08:27:33.991794 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 08:27:33.991794 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:27:33.991794 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:27:33.991794 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:27:33.991794 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:27:33.991794 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:27:33.991794 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:27:33.991794 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:27:33.991794 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application with Lock( May 27 08:27:33.991794 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:27:33.991794 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._enter() May 27 08:27:33.991794 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:27:33.991794 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:27:33.991794 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:27:33.991794 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.creator() May 27 08:27:33.991794 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:27:33.991794 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application created_value = creator( May 27 08:27:33.992750 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 08:27:33.992750 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 08:27:33.992750 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 08:27:33.992750 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application May 27 08:27:33.992750 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 340/675] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 08:27:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 08:27:33.998081 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10b542a-ff40-46d3-be92-c79d1714dd93 None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:34.075505 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:34.088312 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:34.098052 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e95655-06be-4b2e-ac57-3ce7633d4449 None None] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:34.119315 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10b542a-ff40-46d3-be92-c79d1714dd93 None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:34.145092 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b835c0d8-8620-4bd2-965b-35a4ce46227e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:34.146730 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b835c0d8-8620-4bd2-965b-35a4ce46227e None admin] REQUEST_METHOD: `POST` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:34.147196 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b835c0d8-8620-4bd2-965b-35a4ce46227e None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:34.147889 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b835c0d8-8620-4bd2-965b-35a4ce46227e None admin] PATH_INFO: `/v3/services` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:34.149084 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b835c0d8-8620-4bd2-965b-35a4ce46227e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:34.151364 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b835c0d8-8620-4bd2-965b-35a4ce46227e None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:34.158678 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f5906a-7739-46fd-a6e4-bf967bffa2c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:34.159611 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f5906a-7739-46fd-a6e4-bf967bffa2c6 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:34.159966 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f5906a-7739-46fd-a6e4-bf967bffa2c6 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:34.161625 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f5906a-7739-46fd-a6e4-bf967bffa2c6 None admin] PATH_INFO: `/v3/domains` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:34.162625 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f5906a-7739-46fd-a6e4-bf967bffa2c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:27:34.163026 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f5906a-7739-46fd-a6e4-bf967bffa2c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:34.164955 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f5906a-7739-46fd-a6e4-bf967bffa2c6 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:34.177345 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 336/676] 10.222.0.62 () {60 vars in 1141 bytes} [Fri May 27 08:27:33 2022] POST /identity/v3/services => generated 251 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 08:27:34.183375 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 341/677] 10.222.0.62 () {56 vars in 1109 bytes} [Fri May 27 08:27:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:27:34.189956 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b835c0d8-8620-4bd2-965b-35a4ce46227e None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:34.329493 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b835c0d8-8620-4bd2-965b-35a4ce46227e None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:34.369464 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53108e5c-f9c7-4fbd-8494-e17d1767c3c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:34.370195 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53108e5c-f9c7-4fbd-8494-e17d1767c3c0 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:34.370477 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53108e5c-f9c7-4fbd-8494-e17d1767c3c0 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:34.370751 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53108e5c-f9c7-4fbd-8494-e17d1767c3c0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:34.379193 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53108e5c-f9c7-4fbd-8494-e17d1767c3c0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:34.380734 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53108e5c-f9c7-4fbd-8494-e17d1767c3c0 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:34.397720 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application [None req-53108e5c-f9c7-4fbd-8494-e17d1767c3c0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 27 08:27:34.397720 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:27:34.397720 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:27:34.397720 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:27:34.397720 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:27:34.397720 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:27:34.397720 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:27:34.397720 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:27:34.397720 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:27:34.397720 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:27:34.397720 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:27:34.397720 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:27:34.397720 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 08:27:34.397720 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 08:27:34.397720 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 08:27:34.397720 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 08:27:34.398726 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:27:34.398726 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:27:34.398726 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 08:27:34.398726 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 08:27:34.398726 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 08:27:34.398726 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 08:27:34.398726 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:27:34.398726 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:27:34.398726 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:27:34.398726 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:27:34.398726 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:27:34.398726 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application with Lock( May 27 08:27:34.398726 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:27:34.398726 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._enter() May 27 08:27:34.398726 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:27:34.398726 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:27:34.398726 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:27:34.398726 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.creator() May 27 08:27:34.399676 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:27:34.399676 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application created_value = creator( May 27 08:27:34.399676 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 08:27:34.399676 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 08:27:34.399676 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 08:27:34.399676 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 08:27:34.399676 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 08:27:34.399676 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 08:27:34.399676 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 27 08:27:34.399676 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application May 27 08:27:34.399676 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 337/678] 10.222.0.62 () {56 vars in 1093 bytes} [Fri May 27 08:27:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 08:27:34.405296 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f5906a-7739-46fd-a6e4-bf967bffa2c6 None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:34.408675 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11922ff3-7f9e-49ee-ab6b-21c7e0025a37 None None] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:34.408970 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11922ff3-7f9e-49ee-ab6b-21c7e0025a37 None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:34.409370 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11922ff3-7f9e-49ee-ab6b-21c7e0025a37 None None] PATH_INFO: `/` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:34.411303 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 338/679] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:27:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 08:27:34.417100 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f949baf-fb4e-4230-96ac-16c498ab73ca None None] REQUEST_METHOD: `POST` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:34.417443 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f949baf-fb4e-4230-96ac-16c498ab73ca None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:34.417666 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f949baf-fb4e-4230-96ac-16c498ab73ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:34.425228 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:34.441622 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.auth.core [None req-4f949baf-fb4e-4230-96ac-16c498ab73ca None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:27:34.442985 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.fernet_utils [None req-4f949baf-fb4e-4230-96ac-16c498ab73ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:27:34.522846 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 339/680] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:27:34 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 27 08:27:34.536400 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f5906a-7739-46fd-a6e4-bf967bffa2c6 None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:34.555388 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f949baf-fb4e-4230-96ac-16c498ab73ca None None] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:34.577549 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3367fa61-f8da-4174-8605-78695ededc0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:34.579313 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3367fa61-f8da-4174-8605-78695ededc0d None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:34.579807 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3367fa61-f8da-4174-8605-78695ededc0d None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:34.580348 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3367fa61-f8da-4174-8605-78695ededc0d None admin] PATH_INFO: `/v3/users` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:34.581430 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3367fa61-f8da-4174-8605-78695ededc0d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:27:34.581952 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3367fa61-f8da-4174-8605-78695ededc0d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:34.583610 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3367fa61-f8da-4174-8605-78695ededc0d None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:34.603459 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:34.604435 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 342/681] 10.222.0.62 () {56 vars in 1133 bytes} [Fri May 27 08:27:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:27:34.614124 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f079a11c-1ded-4101-ba5b-80b29d765096 None None] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:34.614409 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f079a11c-1ded-4101-ba5b-80b29d765096 None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:34.614813 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f079a11c-1ded-4101-ba5b-80b29d765096 None None] PATH_INFO: `/` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:34.617411 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 343/682] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:27:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:27:34.617411 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f079a11c-1ded-4101-ba5b-80b29d765096 None None] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:34.675818 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f949baf-fb4e-4230-96ac-16c498ab73ca None None] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:34.706968 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:34.714630 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0e1a3b-c75c-4c20-a8f5-ef7c6fce6623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:34.715345 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0e1a3b-c75c-4c20-a8f5-ef7c6fce6623 None admin] REQUEST_METHOD: `POST` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:34.715636 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0e1a3b-c75c-4c20-a8f5-ef7c6fce6623 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:34.715913 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0e1a3b-c75c-4c20-a8f5-ef7c6fce6623 None admin] PATH_INFO: `/v3/services` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:34.716683 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0e1a3b-c75c-4c20-a8f5-ef7c6fce6623 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:34.718094 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0e1a3b-c75c-4c20-a8f5-ef7c6fce6623 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:34.734612 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 340/683] 10.222.0.62 () {60 vars in 1141 bytes} [Fri May 27 08:27:34 2022] POST /identity/v3/services => generated 242 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 08:27:34.736005 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec10e06-e53c-44b3-a69a-d06eca1a59ac None None] REQUEST_METHOD: `POST` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:34.736330 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec10e06-e53c-44b3-a69a-d06eca1a59ac None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:34.736860 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec10e06-e53c-44b3-a69a-d06eca1a59ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:34.759375 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.auth.core [None req-cec10e06-e53c-44b3-a69a-d06eca1a59ac None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:27:34.760650 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.fernet_utils [None req-cec10e06-e53c-44b3-a69a-d06eca1a59ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:27:34.777568 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f079a11c-1ded-4101-ba5b-80b29d765096 None None] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:34.825821 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e0b2a4-4f09-44c1-88b5-0125ef6d8464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:34.826643 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e0b2a4-4f09-44c1-88b5-0125ef6d8464 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:34.826932 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e0b2a4-4f09-44c1-88b5-0125ef6d8464 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:34.827212 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e0b2a4-4f09-44c1-88b5-0125ef6d8464 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:34.844764 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e0b2a4-4f09-44c1-88b5-0125ef6d8464 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:34.846761 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e0b2a4-4f09-44c1-88b5-0125ef6d8464 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:34.851296 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 341/684] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:27:34 2022] POST /identity/v3/auth/tokens => generated 999 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 27 08:27:34.868918 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application [None req-c8e0b2a4-4f09-44c1-88b5-0125ef6d8464 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 08:27:34.868918 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:27:34.868918 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:27:34.868918 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:27:34.868918 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:27:34.868918 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:27:34.868918 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:27:34.868918 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:27:34.868918 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:27:34.868918 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:27:34.868918 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:27:34.868918 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:27:34.868918 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 08:27:34.868918 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 08:27:34.868918 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 08:27:34.869902 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 08:27:34.869902 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:27:34.869902 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:27:34.869902 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:27:34.869902 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:27:34.869902 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:27:34.869902 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:27:34.869902 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:27:34.869902 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application with Lock( May 27 08:27:34.869902 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:27:34.869902 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._enter() May 27 08:27:34.869902 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:27:34.869902 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:27:34.869902 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:27:34.869902 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.creator() May 27 08:27:34.869902 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:27:34.869902 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application created_value = creator( May 27 08:27:34.870823 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 08:27:34.870823 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 08:27:34.870823 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 08:27:34.870823 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application May 27 08:27:34.870823 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 344/685] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 08:27:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 08:27:34.876518 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec10e06-e53c-44b3-a69a-d06eca1a59ac None None] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:34.876736 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e0b2a4-4f09-44c1-88b5-0125ef6d8464 None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:34.949485 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:35.011778 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec10e06-e53c-44b3-a69a-d06eca1a59ac None None] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:35.024637 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e0b2a4-4f09-44c1-88b5-0125ef6d8464 None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:35.040917 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:35.065708 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187c41d6-5707-48aa-89b2-eb3fd7e30fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:35.065918 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82c947d-3af3-4de6-9978-bc46383d6b2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:35.066386 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187c41d6-5707-48aa-89b2-eb3fd7e30fff None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:35.066504 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82c947d-3af3-4de6-9978-bc46383d6b2d None admin] REQUEST_METHOD: `POST` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:35.066675 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187c41d6-5707-48aa-89b2-eb3fd7e30fff None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:35.066795 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82c947d-3af3-4de6-9978-bc46383d6b2d None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:35.066955 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187c41d6-5707-48aa-89b2-eb3fd7e30fff None admin] PATH_INFO: `/v3/domains` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:35.067056 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82c947d-3af3-4de6-9978-bc46383d6b2d None admin] PATH_INFO: `/v3/services` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:35.067692 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82c947d-3af3-4de6-9978-bc46383d6b2d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:35.067812 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187c41d6-5707-48aa-89b2-eb3fd7e30fff None admin] RBAC: Adding query filter params (name=Default) {{(pid=87172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:27:35.067996 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187c41d6-5707-48aa-89b2-eb3fd7e30fff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:35.069145 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82c947d-3af3-4de6-9978-bc46383d6b2d None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:35.069389 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187c41d6-5707-48aa-89b2-eb3fd7e30fff None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:35.089745 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 345/686] 10.222.0.62 () {56 vars in 1109 bytes} [Fri May 27 08:27:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:27:35.090701 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187c41d6-5707-48aa-89b2-eb3fd7e30fff None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:35.092629 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 342/687] 10.222.0.62 () {60 vars in 1141 bytes} [Fri May 27 08:27:34 2022] POST /identity/v3/services => generated 240 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 08:27:35.214939 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:35.218235 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187c41d6-5707-48aa-89b2-eb3fd7e30fff None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:35.266508 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bbbabb-1266-49f9-a6b9-5d7e3cb2cdeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:35.267326 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bbbabb-1266-49f9-a6b9-5d7e3cb2cdeb None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:35.267657 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bbbabb-1266-49f9-a6b9-5d7e3cb2cdeb None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:35.267936 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bbbabb-1266-49f9-a6b9-5d7e3cb2cdeb None admin] PATH_INFO: `/v3/projects/service` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:35.275991 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bbbabb-1266-49f9-a6b9-5d7e3cb2cdeb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:35.277567 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bbbabb-1266-49f9-a6b9-5d7e3cb2cdeb None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:35.293141 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application [None req-e8bbbabb-1266-49f9-a6b9-5d7e3cb2cdeb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 08:27:35.293141 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:27:35.293141 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:27:35.293141 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:27:35.293141 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:27:35.293141 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:27:35.293141 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:27:35.293141 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:27:35.293141 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:27:35.293141 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:27:35.293141 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:27:35.293141 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:27:35.293141 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 08:27:35.293141 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 08:27:35.293141 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 08:27:35.294124 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 08:27:35.294124 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:27:35.294124 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:27:35.294124 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:27:35.294124 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:27:35.294124 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:27:35.294124 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:27:35.294124 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:27:35.294124 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application with Lock( May 27 08:27:35.294124 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:27:35.294124 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._enter() May 27 08:27:35.294124 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:27:35.294124 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:27:35.294124 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:27:35.294124 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.creator() May 27 08:27:35.294124 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:27:35.294124 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application created_value = creator( May 27 08:27:35.295035 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 08:27:35.295035 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 08:27:35.295035 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 08:27:35.295035 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 08:27:35.295035 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 08:27:35.295035 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 08:27:35.295035 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 08:27:35.295035 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application May 27 08:27:35.295035 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 346/688] 10.222.0.62 () {56 vars in 1111 bytes} [Fri May 27 08:27:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 08:27:35.301938 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82c947d-3af3-4de6-9978-bc46383d6b2d None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:35.412860 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82c947d-3af3-4de6-9978-bc46383d6b2d None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:35.449298 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc416851-a735-48fa-9765-e0adb90816d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:35.449958 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc416851-a735-48fa-9765-e0adb90816d3 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:35.450242 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc416851-a735-48fa-9765-e0adb90816d3 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:35.450517 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc416851-a735-48fa-9765-e0adb90816d3 None admin] PATH_INFO: `/v3/projects` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:35.451301 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc416851-a735-48fa-9765-e0adb90816d3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:27:35.451610 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc416851-a735-48fa-9765-e0adb90816d3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:35.453089 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc416851-a735-48fa-9765-e0adb90816d3 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:35.466172 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 343/689] 10.222.0.62 () {56 vars in 1148 bytes} [Fri May 27 08:27:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:27:35.472507 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bbbabb-1266-49f9-a6b9-5d7e3cb2cdeb None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:35.585155 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bbbabb-1266-49f9-a6b9-5d7e3cb2cdeb None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:35.621644 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd204ac2-69be-4e5c-925c-57df39594d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:35.622539 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd204ac2-69be-4e5c-925c-57df39594d5f None admin] REQUEST_METHOD: `PUT` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:35.622822 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd204ac2-69be-4e5c-925c-57df39594d5f None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:35.623095 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd204ac2-69be-4e5c-925c-57df39594d5f None admin] PATH_INFO: `/v3/projects/256f4731060449f1b80067e51e8bec00/users/3a09bdc2dbac4f9abe450ff121e7dce8/roles/5e6f243a7201412c965e7c70249d4dc0` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:35.625660 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd204ac2-69be-4e5c-925c-57df39594d5f None admin] RBAC: Authorizing `identity:create_grant(project_id=256f4731060449f1b80067e51e8bec00, user_id=3a09bdc2dbac4f9abe450ff121e7dce8, role_id=5e6f243a7201412c965e7c70249d4dc0)` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:35.627325 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd204ac2-69be-4e5c-925c-57df39594d5f None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:35.650531 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 347/690] 10.222.0.62 () {58 vars in 1439 bytes} [Fri May 27 08:27:35 2022] PUT /identity/v3/projects/256f4731060449f1b80067e51e8bec00/users/3a09bdc2dbac4f9abe450ff121e7dce8/roles/5e6f243a7201412c965e7c70249d4dc0 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 08:27:36.695209 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd4f190-6322-4325-bd04-113c3f6b16cb None None] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:36.695831 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd4f190-6322-4325-bd04-113c3f6b16cb None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:36.695831 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd4f190-6322-4325-bd04-113c3f6b16cb None None] PATH_INFO: `/` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:36.697430 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 344/691] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:27:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:27:36.702862 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeffdfe-0ae3-4ba6-a1c6-71157c321970 None None] REQUEST_METHOD: `POST` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:36.703777 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeffdfe-0ae3-4ba6-a1c6-71157c321970 None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:36.703963 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeffdfe-0ae3-4ba6-a1c6-71157c321970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:36.722056 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.auth.core [None req-5aeffdfe-0ae3-4ba6-a1c6-71157c321970 None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:27:36.723256 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.fernet_utils [None req-5aeffdfe-0ae3-4ba6-a1c6-71157c321970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:27:36.735152 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:36.796343 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 348/692] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:27:36 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 08:27:36.820131 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd4f190-6322-4325-bd04-113c3f6b16cb None None] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:36.871076 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:36.936073 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd4f190-6322-4325-bd04-113c3f6b16cb None None] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:36.977588 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a3cc55-f110-4ede-8f5e-838ea79c3097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:36.978422 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a3cc55-f110-4ede-8f5e-838ea79c3097 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:36.978708 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a3cc55-f110-4ede-8f5e-838ea79c3097 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:36.978983 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a3cc55-f110-4ede-8f5e-838ea79c3097 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:36.979640 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a3cc55-f110-4ede-8f5e-838ea79c3097 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:36.981063 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a3cc55-f110-4ede-8f5e-838ea79c3097 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:36.994543 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application [None req-22a3cc55-f110-4ede-8f5e-838ea79c3097 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 27 08:27:36.994543 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:27:36.994543 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 08:27:36.994543 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 08:27:36.994543 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 08:27:36.994543 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 08:27:36.994543 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 08:27:36.994543 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 08:27:36.994543 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 27 08:27:36.994543 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application May 27 08:27:36.994543 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 08:27:36.994543 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application May 27 08:27:36.994543 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:27:36.994543 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:27:36.994543 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:27:36.994543 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:27:36.995510 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:27:36.995510 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:27:36.995510 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:27:36.995510 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:27:36.995510 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:27:36.995510 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:27:36.995510 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:27:36.995510 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 08:27:36.995510 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 08:27:36.995510 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 08:27:36.995510 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 08:27:36.995510 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:27:36.995510 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:27:36.995510 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:27:36.995510 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:27:36.995510 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:27:36.996339 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:27:36.996339 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:27:36.996339 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application with Lock( May 27 08:27:36.996339 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:27:36.996339 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._enter() May 27 08:27:36.996339 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:27:36.996339 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:27:36.996339 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:27:36.996339 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.creator() May 27 08:27:36.996339 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:27:36.996339 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application created_value = creator( May 27 08:27:36.996339 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 08:27:36.996339 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 08:27:36.996339 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 27 08:27:36.996339 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application May 27 08:27:36.996339 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 345/693] 10.222.0.62 () {56 vars in 1129 bytes} [Fri May 27 08:27:36 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 08:27:37.003893 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeffdfe-0ae3-4ba6-a1c6-71157c321970 None None] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:37.108271 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeffdfe-0ae3-4ba6-a1c6-71157c321970 None None] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:37.144358 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c837c7-d4b1-41fb-b29c-472d8de1817b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:37.145063 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c837c7-d4b1-41fb-b29c-472d8de1817b None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:37.145353 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c837c7-d4b1-41fb-b29c-472d8de1817b None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:37.145636 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c837c7-d4b1-41fb-b29c-472d8de1817b None admin] PATH_INFO: `/v3/services` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:37.146367 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c837c7-d4b1-41fb-b29c-472d8de1817b None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:27:37.146660 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c837c7-d4b1-41fb-b29c-472d8de1817b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:37.148056 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c837c7-d4b1-41fb-b29c-472d8de1817b None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:37.153508 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 349/694] 10.222.0.62 () {56 vars in 1124 bytes} [Fri May 27 08:27:37 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:27:37.154506 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3dd3fa-957f-46f4-bb2c-3f030c371dfe None None] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:37.154806 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3dd3fa-957f-46f4-bb2c-3f030c371dfe None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:37.155092 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3dd3fa-957f-46f4-bb2c-3f030c371dfe None None] PATH_INFO: `/` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:37.157502 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 346/695] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:27:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:27:37.159349 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c837c7-d4b1-41fb-b29c-472d8de1817b None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:37.162645 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2814355d-0ed6-4962-a3f4-fec40fa4923b None None] REQUEST_METHOD: `POST` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:37.162937 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2814355d-0ed6-4962-a3f4-fec40fa4923b None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:37.163219 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2814355d-0ed6-4962-a3f4-fec40fa4923b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:37.180278 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.auth.core [None req-2814355d-0ed6-4962-a3f4-fec40fa4923b None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:27:37.181675 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.fernet_utils [None req-2814355d-0ed6-4962-a3f4-fec40fa4923b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:27:37.186505 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:37.270465 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 347/696] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:27:37 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 08:27:37.276273 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c837c7-d4b1-41fb-b29c-472d8de1817b None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:37.295439 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2814355d-0ed6-4962-a3f4-fec40fa4923b None None] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:37.317637 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2c2982-45f7-4aef-b444-74c8be2481fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:37.318772 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2c2982-45f7-4aef-b444-74c8be2481fd None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:37.319289 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2c2982-45f7-4aef-b444-74c8be2481fd None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:37.319774 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2c2982-45f7-4aef-b444-74c8be2481fd None admin] PATH_INFO: `/v3/services` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:37.320737 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2c2982-45f7-4aef-b444-74c8be2481fd None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:27:37.321353 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2c2982-45f7-4aef-b444-74c8be2481fd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:37.322949 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2c2982-45f7-4aef-b444-74c8be2481fd None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:37.329268 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 350/697] 10.222.0.62 () {56 vars in 1124 bytes} [Fri May 27 08:27:37 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:27:37.335463 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2c2982-45f7-4aef-b444-74c8be2481fd None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:37.343021 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:37.433304 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2814355d-0ed6-4962-a3f4-fec40fa4923b None None] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:37.451381 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:37.472218 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e1fd2c-1465-4240-8c39-e80f163eab69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:37.473051 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e1fd2c-1465-4240-8c39-e80f163eab69 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:37.473353 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e1fd2c-1465-4240-8c39-e80f163eab69 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:37.473617 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e1fd2c-1465-4240-8c39-e80f163eab69 None admin] PATH_INFO: `/v3/services/image` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:37.474262 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e1fd2c-1465-4240-8c39-e80f163eab69 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:37.475641 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e1fd2c-1465-4240-8c39-e80f163eab69 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:37.487214 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2c2982-45f7-4aef-b444-74c8be2481fd None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:37.488732 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application [None req-61e1fd2c-1465-4240-8c39-e80f163eab69 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 27 08:27:37.488732 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:27:37.488732 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 08:27:37.488732 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 08:27:37.488732 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 08:27:37.488732 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 08:27:37.488732 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 08:27:37.488732 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 08:27:37.488732 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 27 08:27:37.488732 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application May 27 08:27:37.488732 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 08:27:37.488732 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application May 27 08:27:37.488732 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:27:37.488732 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:27:37.488732 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:27:37.488732 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:27:37.488732 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:27:37.489693 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:27:37.489693 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:27:37.489693 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:27:37.489693 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:27:37.489693 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:27:37.489693 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:27:37.489693 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 08:27:37.489693 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 08:27:37.489693 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 08:27:37.489693 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 08:27:37.489693 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:27:37.489693 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:27:37.489693 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:27:37.489693 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:27:37.489693 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:27:37.489693 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:27:37.490531 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:27:37.490531 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application with Lock( May 27 08:27:37.490531 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:27:37.490531 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._enter() May 27 08:27:37.490531 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:27:37.490531 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:27:37.490531 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:27:37.490531 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.creator() May 27 08:27:37.490531 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:27:37.490531 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application created_value = creator( May 27 08:27:37.490531 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 08:27:37.490531 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 08:27:37.490531 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 27 08:27:37.490531 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application May 27 08:27:37.490531 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 348/698] 10.222.0.62 () {56 vars in 1105 bytes} [Fri May 27 08:27:37 2022] GET /identity/v3/services/image => generated 86 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 08:27:37.499413 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e1fd2c-1465-4240-8c39-e80f163eab69 None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:37.536621 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133d00a0-a0ef-4644-8c84-7924e551edf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:37.537314 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133d00a0-a0ef-4644-8c84-7924e551edf8 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:37.537646 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133d00a0-a0ef-4644-8c84-7924e551edf8 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:37.537980 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133d00a0-a0ef-4644-8c84-7924e551edf8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:37.538783 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133d00a0-a0ef-4644-8c84-7924e551edf8 None admin] RBAC: Adding query filter params (interface=public, service_id=5e5a1d9732834f5987b560ee327adfb4, region_id=RegionOne) {{(pid=87172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:27:37.539094 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133d00a0-a0ef-4644-8c84-7924e551edf8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:37.540481 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133d00a0-a0ef-4644-8c84-7924e551edf8 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:37.552847 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 351/699] 10.222.0.62 () {56 vars in 1251 bytes} [Fri May 27 08:27:37 2022] GET /identity/v3/endpoints?service_id=5e5a1d9732834f5987b560ee327adfb4&interface=public®ion_id=RegionOne => generated 194 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 08:27:37.555154 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133d00a0-a0ef-4644-8c84-7924e551edf8 None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:37.622263 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:37.626953 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e1fd2c-1465-4240-8c39-e80f163eab69 None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:37.664873 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e1e876-792c-4adb-80eb-3ea378c14715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:37.665635 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e1e876-792c-4adb-80eb-3ea378c14715 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:37.665921 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e1e876-792c-4adb-80eb-3ea378c14715 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:37.666202 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e1e876-792c-4adb-80eb-3ea378c14715 None admin] PATH_INFO: `/v3/services` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:37.666904 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e1e876-792c-4adb-80eb-3ea378c14715 None admin] RBAC: Adding query filter params (name=image) {{(pid=87173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:27:37.667210 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e1e876-792c-4adb-80eb-3ea378c14715 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:37.668283 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133d00a0-a0ef-4644-8c84-7924e551edf8 None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:37.668623 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e1e876-792c-4adb-80eb-3ea378c14715 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:37.678512 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 349/700] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 08:27:37 2022] GET /identity/v3/services?name=image => generated 122 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:27:37.678512 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda29508-525b-4f02-91ae-11cbd256ae61 None None] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:37.678512 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda29508-525b-4f02-91ae-11cbd256ae61 None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:37.678512 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda29508-525b-4f02-91ae-11cbd256ae61 None None] PATH_INFO: `/` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:37.678512 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 350/701] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:27:37 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:27:37.682071 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda29508-525b-4f02-91ae-11cbd256ae61 None None] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:37.710243 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90400b1-6f1c-49d3-adbc-b2090b7893fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:37.711545 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90400b1-6f1c-49d3-adbc-b2090b7893fe None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:37.711828 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90400b1-6f1c-49d3-adbc-b2090b7893fe None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:37.712107 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90400b1-6f1c-49d3-adbc-b2090b7893fe None admin] PATH_INFO: `/v3/services` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:37.712839 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90400b1-6f1c-49d3-adbc-b2090b7893fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:37.714218 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90400b1-6f1c-49d3-adbc-b2090b7893fe None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:37.728618 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 352/702] 10.222.0.62 () {56 vars in 1087 bytes} [Fri May 27 08:27:37 2022] GET /identity/v3/services => generated 1002 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 08:27:37.728618 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9944bcf2-4b58-4af7-928a-d7a3195816b6 None None] REQUEST_METHOD: `POST` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:37.728618 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9944bcf2-4b58-4af7-928a-d7a3195816b6 None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:37.728618 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9944bcf2-4b58-4af7-928a-d7a3195816b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:37.735124 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:37.754342 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.auth.core [None req-9944bcf2-4b58-4af7-928a-d7a3195816b6 None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:27:37.755590 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.fernet_utils [None req-9944bcf2-4b58-4af7-928a-d7a3195816b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:27:37.817051 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda29508-525b-4f02-91ae-11cbd256ae61 None None] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:37.849835 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 353/703] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:27:37 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 08:27:37.863905 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8399813-6361-451e-92ca-c8ab8e75b54e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:37.865008 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8399813-6361-451e-92ca-c8ab8e75b54e None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:37.865497 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8399813-6361-451e-92ca-c8ab8e75b54e None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:37.865970 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8399813-6361-451e-92ca-c8ab8e75b54e None admin] PATH_INFO: `/v3/services` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:37.866972 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8399813-6361-451e-92ca-c8ab8e75b54e None admin] RBAC: Adding query filter params (type=image) {{(pid=87173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:27:37.867496 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8399813-6361-451e-92ca-c8ab8e75b54e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:37.869225 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8399813-6361-451e-92ca-c8ab8e75b54e None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:37.875953 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9944bcf2-4b58-4af7-928a-d7a3195816b6 None None] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:37.877290 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 351/704] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 08:27:37 2022] GET /identity/v3/services?type=image => generated 350 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:27:37.885763 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8399813-6361-451e-92ca-c8ab8e75b54e None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:37.919823 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:38.010354 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8399813-6361-451e-92ca-c8ab8e75b54e None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:38.018558 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9944bcf2-4b58-4af7-928a-d7a3195816b6 None None] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:38.053919 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08777843-f450-48cd-b027-360714ea7ee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:38.054611 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08777843-f450-48cd-b027-360714ea7ee3 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:38.054898 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08777843-f450-48cd-b027-360714ea7ee3 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:38.055166 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08777843-f450-48cd-b027-360714ea7ee3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:38.055992 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08777843-f450-48cd-b027-360714ea7ee3 None admin] RBAC: Adding query filter params (interface=public, service_id=823cbd761ccb4cc0a2bfb8d4e4395a39, region_id=RegionOne) {{(pid=87173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:27:38.056272 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08777843-f450-48cd-b027-360714ea7ee3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:38.057724 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08777843-f450-48cd-b027-360714ea7ee3 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:38.064732 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:38.067184 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 352/705] 10.222.0.62 () {56 vars in 1251 bytes} [Fri May 27 08:27:37 2022] GET /identity/v3/endpoints?service_id=823cbd761ccb4cc0a2bfb8d4e4395a39&interface=public®ion_id=RegionOne => generated 194 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:27:38.071359 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c5dc47-4222-45a1-b21f-f1501fee442f None None] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:38.071645 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c5dc47-4222-45a1-b21f-f1501fee442f None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:38.071925 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c5dc47-4222-45a1-b21f-f1501fee442f None None] PATH_INFO: `/` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:38.073316 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 353/706] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:27:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 08:27:38.074063 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c5dc47-4222-45a1-b21f-f1501fee442f None None] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:38.077138 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9715c7c9-0f97-40d1-82c9-af9e646bf007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:38.078715 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9715c7c9-0f97-40d1-82c9-af9e646bf007 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:38.079459 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9715c7c9-0f97-40d1-82c9-af9e646bf007 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:38.079880 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9715c7c9-0f97-40d1-82c9-af9e646bf007 None admin] PATH_INFO: `/v3/services/network` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:38.080556 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9715c7c9-0f97-40d1-82c9-af9e646bf007 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:38.081974 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9715c7c9-0f97-40d1-82c9-af9e646bf007 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:38.095052 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application [None req-9715c7c9-0f97-40d1-82c9-af9e646bf007 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 27 08:27:38.095052 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:27:38.095052 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 08:27:38.095052 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 08:27:38.095052 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 08:27:38.095052 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 08:27:38.095052 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 08:27:38.095052 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 08:27:38.095052 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 27 08:27:38.095052 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application May 27 08:27:38.095052 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 08:27:38.095052 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application May 27 08:27:38.095052 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:27:38.095052 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:27:38.095052 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:27:38.095052 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:27:38.095052 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:27:38.096187 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:27:38.096187 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:27:38.096187 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:27:38.096187 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:27:38.096187 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:27:38.096187 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:27:38.096187 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 08:27:38.096187 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 08:27:38.096187 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 08:27:38.096187 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 08:27:38.096187 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:27:38.096187 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:27:38.096187 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:27:38.096187 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:27:38.096187 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:27:38.096187 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:27:38.097681 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:27:38.097681 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application with Lock( May 27 08:27:38.097681 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:27:38.097681 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._enter() May 27 08:27:38.097681 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:27:38.097681 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:27:38.097681 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:27:38.097681 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.creator() May 27 08:27:38.097681 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:27:38.097681 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application created_value = creator( May 27 08:27:38.097681 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 08:27:38.097681 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 08:27:38.097681 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 27 08:27:38.097681 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application May 27 08:27:38.097681 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 354/707] 10.222.0.62 () {56 vars in 1111 bytes} [Fri May 27 08:27:37 2022] GET /identity/v3/services/network => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 08:27:38.098471 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b557e5b-a853-425d-b4af-88a21d2896cd None None] REQUEST_METHOD: `POST` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:38.098471 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b557e5b-a853-425d-b4af-88a21d2896cd None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:38.098471 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b557e5b-a853-425d-b4af-88a21d2896cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:38.117416 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.auth.core [None req-7b557e5b-a853-425d-b4af-88a21d2896cd None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:27:38.118606 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.fernet_utils [None req-7b557e5b-a853-425d-b4af-88a21d2896cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:27:38.187002 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:38.196851 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 355/708] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:27:38 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 08:27:38.198607 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b557e5b-a853-425d-b4af-88a21d2896cd None None] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:38.200033 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c5dc47-4222-45a1-b21f-f1501fee442f None None] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:38.239625 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af295f7c-2058-44b8-8459-a718e5860447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:38.240284 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af295f7c-2058-44b8-8459-a718e5860447 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:38.240565 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af295f7c-2058-44b8-8459-a718e5860447 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:38.240891 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af295f7c-2058-44b8-8459-a718e5860447 None admin] PATH_INFO: `/v3/services` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:38.241537 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af295f7c-2058-44b8-8459-a718e5860447 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:38.242919 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af295f7c-2058-44b8-8459-a718e5860447 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:38.249818 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 354/709] 10.222.0.62 () {56 vars in 1087 bytes} [Fri May 27 08:27:38 2022] GET /identity/v3/services => generated 1002 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 08:27:38.251489 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af295f7c-2058-44b8-8459-a718e5860447 None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:38.338339 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b557e5b-a853-425d-b4af-88a21d2896cd None None] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:38.374751 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af295f7c-2058-44b8-8459-a718e5860447 None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:38.382914 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:38.396662 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4059ae0-1b74-43f2-b5fd-396d2b9fef5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:38.397610 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4059ae0-1b74-43f2-b5fd-396d2b9fef5f None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:38.398077 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4059ae0-1b74-43f2-b5fd-396d2b9fef5f None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:38.398509 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4059ae0-1b74-43f2-b5fd-396d2b9fef5f None admin] PATH_INFO: `/v3/services` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:38.399995 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4059ae0-1b74-43f2-b5fd-396d2b9fef5f None admin] RBAC: Adding query filter params (name=network) {{(pid=87172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:27:38.400480 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4059ae0-1b74-43f2-b5fd-396d2b9fef5f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:38.402618 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4059ae0-1b74-43f2-b5fd-396d2b9fef5f None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:38.412884 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 356/710] 10.222.0.62 () {56 vars in 1112 bytes} [Fri May 27 08:27:38 2022] GET /identity/v3/services?name=network => generated 124 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:27:38.416175 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32591de-d954-4da7-8e75-267bfad14b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:38.420781 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32591de-d954-4da7-8e75-267bfad14b04 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:38.420781 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32591de-d954-4da7-8e75-267bfad14b04 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:38.420781 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32591de-d954-4da7-8e75-267bfad14b04 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:38.421123 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4059ae0-1b74-43f2-b5fd-396d2b9fef5f None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:38.434608 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32591de-d954-4da7-8e75-267bfad14b04 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 08:27:38.443637 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application [None req-f32591de-d954-4da7-8e75-267bfad14b04 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 08:27:38.443637 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:27:38.443637 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:27:38.443637 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:27:38.443637 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:27:38.443637 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:27:38.443637 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:27:38.443637 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:27:38.443637 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:27:38.443637 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:27:38.443637 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:27:38.443637 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:27:38.443637 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 08:27:38.443637 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 08:27:38.443637 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 08:27:38.443637 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 08:27:38.444850 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 08:27:38.444850 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 08:27:38.444850 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 08:27:38.444850 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 08:27:38.444850 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:27:38.444850 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:27:38.444850 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:27:38.444850 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:27:38.444850 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:27:38.444850 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:27:38.444850 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:27:38.444850 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application with Lock( May 27 08:27:38.444850 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:27:38.444850 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._enter() May 27 08:27:38.444850 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:27:38.444850 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:27:38.445695 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:27:38.445695 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.creator() May 27 08:27:38.445695 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:27:38.445695 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application created_value = creator( May 27 08:27:38.445695 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 08:27:38.445695 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 08:27:38.445695 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 08:27:38.445695 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 08:27:38.445695 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 08:27:38.445695 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 08:27:38.445695 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 08:27:38.445695 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application May 27 08:27:38.448417 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 355/711] 10.222.0.62 () {56 vars in 1096 bytes} [Fri May 27 08:27:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 08:27:38.457152 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32591de-d954-4da7-8e75-267bfad14b04 None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:38.482817 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:38.544523 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4059ae0-1b74-43f2-b5fd-396d2b9fef5f None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:38.592944 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0155f652-3e7b-4d9d-951b-812c92d3cf33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:38.594437 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0155f652-3e7b-4d9d-951b-812c92d3cf33 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:38.594763 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0155f652-3e7b-4d9d-951b-812c92d3cf33 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:38.595958 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0155f652-3e7b-4d9d-951b-812c92d3cf33 None admin] PATH_INFO: `/v3/services` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:38.597089 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0155f652-3e7b-4d9d-951b-812c92d3cf33 None admin] RBAC: Adding query filter params (type=network) {{(pid=87172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:27:38.597580 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0155f652-3e7b-4d9d-951b-812c92d3cf33 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:38.599253 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0155f652-3e7b-4d9d-951b-812c92d3cf33 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:38.601586 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32591de-d954-4da7-8e75-267bfad14b04 None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:38.606836 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 357/712] 10.222.0.62 () {56 vars in 1112 bytes} [Fri May 27 08:27:38 2022] GET /identity/v3/services?type=network => generated 350 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:27:38.615886 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0155f652-3e7b-4d9d-951b-812c92d3cf33 None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:38.651715 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bd2727-e79e-4432-9cb2-6d44686aac4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:38.652685 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bd2727-e79e-4432-9cb2-6d44686aac4b None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:38.652972 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bd2727-e79e-4432-9cb2-6d44686aac4b None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:38.653699 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bd2727-e79e-4432-9cb2-6d44686aac4b None admin] PATH_INFO: `/v3/roles` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:38.654735 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bd2727-e79e-4432-9cb2-6d44686aac4b None admin] RBAC: Adding query filter params (name=admin) {{(pid=87173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:27:38.655054 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bd2727-e79e-4432-9cb2-6d44686aac4b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:38.657408 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bd2727-e79e-4432-9cb2-6d44686aac4b None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:38.669998 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 356/713] 10.222.0.62 () {56 vars in 1099 bytes} [Fri May 27 08:27:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:27:38.676552 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bd2727-e79e-4432-9cb2-6d44686aac4b None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:38.695769 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:38.748098 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0155f652-3e7b-4d9d-951b-812c92d3cf33 None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:38.784477 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c2fc02-8156-4be3-b8a4-75a2fd8b9a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:38.785333 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c2fc02-8156-4be3-b8a4-75a2fd8b9a7f None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:38.785961 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c2fc02-8156-4be3-b8a4-75a2fd8b9a7f None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:38.786138 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:38.786420 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c2fc02-8156-4be3-b8a4-75a2fd8b9a7f None admin] PATH_INFO: `/v3/endpoints` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:38.787313 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c2fc02-8156-4be3-b8a4-75a2fd8b9a7f None admin] RBAC: Adding query filter params (interface=public, service_id=11d8ebee56264c7da7ccd2b89c8e8378, region_id=RegionOne) {{(pid=87172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:27:38.787717 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c2fc02-8156-4be3-b8a4-75a2fd8b9a7f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:38.790060 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c2fc02-8156-4be3-b8a4-75a2fd8b9a7f None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:38.795733 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 358/714] 10.222.0.62 () {56 vars in 1251 bytes} [Fri May 27 08:27:38 2022] GET /identity/v3/endpoints?service_id=11d8ebee56264c7da7ccd2b89c8e8378&interface=public®ion_id=RegionOne => generated 194 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 08:27:38.801217 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c2fc02-8156-4be3-b8a4-75a2fd8b9a7f None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:38.811312 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bd2727-e79e-4432-9cb2-6d44686aac4b None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:38.850306 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59fc588-5071-4eb4-923d-3772cb03b1c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:38.851054 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59fc588-5071-4eb4-923d-3772cb03b1c8 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:38.851415 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59fc588-5071-4eb4-923d-3772cb03b1c8 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:38.851702 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59fc588-5071-4eb4-923d-3772cb03b1c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:38.864617 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59fc588-5071-4eb4-923d-3772cb03b1c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:38.866278 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59fc588-5071-4eb4-923d-3772cb03b1c8 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:38.885833 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application [None req-a59fc588-5071-4eb4-923d-3772cb03b1c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 08:27:38.885833 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:27:38.885833 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:27:38.885833 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:27:38.885833 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:27:38.885833 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:27:38.885833 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:27:38.885833 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:27:38.885833 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:27:38.885833 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:27:38.885833 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:27:38.885833 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:27:38.885833 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 08:27:38.885833 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 08:27:38.885833 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 08:27:38.886973 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 08:27:38.886973 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:27:38.886973 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:27:38.886973 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:27:38.886973 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:27:38.886973 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:27:38.886973 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:27:38.886973 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:27:38.886973 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application with Lock( May 27 08:27:38.886973 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:27:38.886973 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._enter() May 27 08:27:38.886973 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:27:38.886973 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:27:38.886973 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:27:38.886973 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.creator() May 27 08:27:38.886973 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:27:38.886973 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application created_value = creator( May 27 08:27:38.888768 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 08:27:38.888768 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 08:27:38.888768 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 08:27:38.888768 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application May 27 08:27:38.888768 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 357/715] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 08:27:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 08:27:38.893451 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59fc588-5071-4eb4-923d-3772cb03b1c8 None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:38.930098 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c2fc02-8156-4be3-b8a4-75a2fd8b9a7f None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:38.951435 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:38.973929 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb366902-a1ab-472d-a389-b3ce05b86ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:38.974975 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb366902-a1ab-472d-a389-b3ce05b86ce2 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:38.975458 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb366902-a1ab-472d-a389-b3ce05b86ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:38.976048 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb366902-a1ab-472d-a389-b3ce05b86ce2 None admin] PATH_INFO: `/v3/services` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:38.977061 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb366902-a1ab-472d-a389-b3ce05b86ce2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:38.978633 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb366902-a1ab-472d-a389-b3ce05b86ce2 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:38.993155 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 359/716] 10.222.0.62 () {56 vars in 1087 bytes} [Fri May 27 08:27:38 2022] GET /identity/v3/services => generated 1002 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 08:27:39.017019 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59fc588-5071-4eb4-923d-3772cb03b1c8 None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:39.051420 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:39.057927 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1059cd61-a644-4708-a857-8c18e11efbf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:39.059118 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1059cd61-a644-4708-a857-8c18e11efbf6 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:39.059804 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1059cd61-a644-4708-a857-8c18e11efbf6 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:39.060088 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1059cd61-a644-4708-a857-8c18e11efbf6 None admin] PATH_INFO: `/v3/domains` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:39.060882 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1059cd61-a644-4708-a857-8c18e11efbf6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:27:39.061195 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1059cd61-a644-4708-a857-8c18e11efbf6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:39.062752 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1059cd61-a644-4708-a857-8c18e11efbf6 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:39.077846 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 358/717] 10.222.0.62 () {56 vars in 1109 bytes} [Fri May 27 08:27:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:27:39.084673 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb366902-a1ab-472d-a389-b3ce05b86ce2 None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:39.202271 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb366902-a1ab-472d-a389-b3ce05b86ce2 None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:39.240306 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031d7048-2262-4ded-b82f-e5158a3e374c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:39.241419 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031d7048-2262-4ded-b82f-e5158a3e374c None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:39.241930 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031d7048-2262-4ded-b82f-e5158a3e374c None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:39.242383 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031d7048-2262-4ded-b82f-e5158a3e374c None admin] PATH_INFO: `/v3/users/nova` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:39.250998 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031d7048-2262-4ded-b82f-e5158a3e374c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:39.252904 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031d7048-2262-4ded-b82f-e5158a3e374c None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:39.269191 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application [None req-031d7048-2262-4ded-b82f-e5158a3e374c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 27 08:27:39.269191 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:27:39.269191 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:27:39.269191 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:27:39.269191 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:27:39.269191 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:27:39.269191 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:27:39.269191 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:27:39.269191 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:27:39.269191 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:27:39.269191 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:27:39.269191 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:27:39.269191 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 08:27:39.269191 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 08:27:39.269191 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 08:27:39.269191 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 08:27:39.270179 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:27:39.270179 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:27:39.270179 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 08:27:39.270179 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 08:27:39.270179 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 08:27:39.270179 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 08:27:39.270179 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:27:39.270179 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:27:39.270179 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:27:39.270179 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:27:39.270179 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:27:39.270179 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application with Lock( May 27 08:27:39.270179 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:27:39.270179 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._enter() May 27 08:27:39.270179 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:27:39.270179 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:27:39.270179 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:27:39.270179 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.creator() May 27 08:27:39.271134 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:27:39.271134 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application created_value = creator( May 27 08:27:39.271134 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 08:27:39.271134 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 08:27:39.271134 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 08:27:39.271134 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 08:27:39.271134 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 08:27:39.271134 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 08:27:39.271134 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 27 08:27:39.271134 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application May 27 08:27:39.273413 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 360/718] 10.222.0.62 () {56 vars in 1093 bytes} [Fri May 27 08:27:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 08:27:39.279182 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1059cd61-a644-4708-a857-8c18e11efbf6 None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:39.385016 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1059cd61-a644-4708-a857-8c18e11efbf6 None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:39.421537 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbedc04-c96b-4bf4-833e-1b566f5716d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:39.422803 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbedc04-c96b-4bf4-833e-1b566f5716d8 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:39.423246 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbedc04-c96b-4bf4-833e-1b566f5716d8 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:39.423689 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbedc04-c96b-4bf4-833e-1b566f5716d8 None admin] PATH_INFO: `/v3/users` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:39.424696 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbedc04-c96b-4bf4-833e-1b566f5716d8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:27:39.425202 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbedc04-c96b-4bf4-833e-1b566f5716d8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:39.426838 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbedc04-c96b-4bf4-833e-1b566f5716d8 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:39.446431 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 359/719] 10.222.0.62 () {56 vars in 1133 bytes} [Fri May 27 08:27:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:27:39.452429 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031d7048-2262-4ded-b82f-e5158a3e374c None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:39.504908 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:39.569099 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031d7048-2262-4ded-b82f-e5158a3e374c None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:39.606485 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1381ecd-ad91-4f2c-a01b-d4eef447c88d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:39.607139 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1381ecd-ad91-4f2c-a01b-d4eef447c88d None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:39.607424 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1381ecd-ad91-4f2c-a01b-d4eef447c88d None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:39.607702 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1381ecd-ad91-4f2c-a01b-d4eef447c88d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:39.687810 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1381ecd-ad91-4f2c-a01b-d4eef447c88d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:39.689575 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1381ecd-ad91-4f2c-a01b-d4eef447c88d None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:39.736335 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:39.813482 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 361/720] 10.222.0.62 () {58 vars in 1282 bytes} [Fri May 27 08:27:39 2022] GET /identity/v3/auth/tokens => generated 1098 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 08:27:39.817783 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbedc04-c96b-4bf4-833e-1b566f5716d8 None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:39.882446 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:39.946011 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbedc04-c96b-4bf4-833e-1b566f5716d8 None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:39.982400 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346e6bb5-39b3-481c-88e2-cc1aea6a291b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:39.983199 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346e6bb5-39b3-481c-88e2-cc1aea6a291b None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:39.983483 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346e6bb5-39b3-481c-88e2-cc1aea6a291b None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:39.983760 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346e6bb5-39b3-481c-88e2-cc1aea6a291b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:39.994720 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346e6bb5-39b3-481c-88e2-cc1aea6a291b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:39.996132 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346e6bb5-39b3-481c-88e2-cc1aea6a291b None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:40.014645 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application [None req-346e6bb5-39b3-481c-88e2-cc1aea6a291b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 08:27:40.014645 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:27:40.014645 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:27:40.014645 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:27:40.014645 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:27:40.014645 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:27:40.014645 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:27:40.014645 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:27:40.014645 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:27:40.014645 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:27:40.014645 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:27:40.014645 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:27:40.014645 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 08:27:40.014645 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 08:27:40.014645 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 08:27:40.015988 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 08:27:40.015988 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:27:40.015988 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:27:40.015988 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:27:40.015988 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:27:40.015988 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:27:40.015988 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:27:40.015988 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:27:40.015988 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application with Lock( May 27 08:27:40.015988 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:27:40.015988 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._enter() May 27 08:27:40.015988 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:27:40.015988 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:27:40.015988 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:27:40.015988 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.creator() May 27 08:27:40.015988 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:27:40.015988 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application created_value = creator( May 27 08:27:40.018305 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 08:27:40.018305 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 08:27:40.018305 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 08:27:40.018305 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application May 27 08:27:40.018305 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 360/721] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 08:27:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 08:27:40.022103 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1381ecd-ad91-4f2c-a01b-d4eef447c88d None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:40.145635 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1381ecd-ad91-4f2c-a01b-d4eef447c88d None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:40.184502 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf675fd-9116-42ac-9abc-086b89154358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:40.185602 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf675fd-9116-42ac-9abc-086b89154358 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:40.186161 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf675fd-9116-42ac-9abc-086b89154358 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:40.186689 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf675fd-9116-42ac-9abc-086b89154358 None admin] PATH_INFO: `/v3/domains` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:40.187721 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf675fd-9116-42ac-9abc-086b89154358 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:27:40.188260 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf675fd-9116-42ac-9abc-086b89154358 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:40.189991 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf675fd-9116-42ac-9abc-086b89154358 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:40.204287 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 362/722] 10.222.0.62 () {56 vars in 1109 bytes} [Fri May 27 08:27:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:27:40.210255 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346e6bb5-39b3-481c-88e2-cc1aea6a291b None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:40.251089 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2f8f2e-4dbd-4b67-9e31-c9c7ffff6032 None None] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:40.251719 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2f8f2e-4dbd-4b67-9e31-c9c7ffff6032 None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:40.252212 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2f8f2e-4dbd-4b67-9e31-c9c7ffff6032 None None] PATH_INFO: `/` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:40.254393 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 363/723] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:27:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:27:40.262570 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73771fd-be89-4d0e-9f99-14f02db83925 None None] REQUEST_METHOD: `POST` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:40.263233 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73771fd-be89-4d0e-9f99-14f02db83925 None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:40.263751 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73771fd-be89-4d0e-9f99-14f02db83925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:40.269899 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:40.284554 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.auth.core [None req-c73771fd-be89-4d0e-9f99-14f02db83925 None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:27:40.286443 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.fernet_utils [None req-c73771fd-be89-4d0e-9f99-14f02db83925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:27:40.326649 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346e6bb5-39b3-481c-88e2-cc1aea6a291b None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:40.339040 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:40.368697 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 364/724] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:27:40 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 08:27:40.370495 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f349e9c0-8ec5-4338-938f-39927d4f7405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:40.371314 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f349e9c0-8ec5-4338-938f-39927d4f7405 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:40.371603 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f349e9c0-8ec5-4338-938f-39927d4f7405 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:40.371885 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f349e9c0-8ec5-4338-938f-39927d4f7405 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:40.379444 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f349e9c0-8ec5-4338-938f-39927d4f7405 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:40.380971 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f349e9c0-8ec5-4338-938f-39927d4f7405 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:40.387750 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73771fd-be89-4d0e-9f99-14f02db83925 None None] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:40.401348 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application [None req-f349e9c0-8ec5-4338-938f-39927d4f7405 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 08:27:40.401348 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:27:40.401348 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:27:40.401348 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:27:40.401348 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:27:40.401348 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:27:40.401348 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:27:40.401348 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:27:40.401348 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:27:40.401348 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:27:40.401348 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:27:40.401348 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:27:40.401348 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 08:27:40.401348 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 08:27:40.401348 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 08:27:40.402326 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 08:27:40.402326 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:27:40.402326 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:27:40.402326 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:27:40.402326 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:27:40.402326 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:27:40.402326 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:27:40.402326 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:27:40.402326 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application with Lock( May 27 08:27:40.402326 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:27:40.402326 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._enter() May 27 08:27:40.402326 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:27:40.402326 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:27:40.402326 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:27:40.402326 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.creator() May 27 08:27:40.402326 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:27:40.402326 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application created_value = creator( May 27 08:27:40.403213 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 08:27:40.403213 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 08:27:40.403213 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 08:27:40.403213 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 08:27:40.403213 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 08:27:40.403213 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 08:27:40.403213 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 08:27:40.403213 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application May 27 08:27:40.406266 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 361/725] 10.222.0.62 () {56 vars in 1111 bytes} [Fri May 27 08:27:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 08:27:40.412828 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f349e9c0-8ec5-4338-938f-39927d4f7405 None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:40.527564 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73771fd-be89-4d0e-9f99-14f02db83925 None None] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:40.557608 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f349e9c0-8ec5-4338-938f-39927d4f7405 None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:40.567685 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:40.580896 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86cb447-cb08-4b01-ad0c-3a0f4eeb78d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:40.582154 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86cb447-cb08-4b01-ad0c-3a0f4eeb78d1 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:40.582634 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86cb447-cb08-4b01-ad0c-3a0f4eeb78d1 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:40.583122 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86cb447-cb08-4b01-ad0c-3a0f4eeb78d1 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:40.584083 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86cb447-cb08-4b01-ad0c-3a0f4eeb78d1 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:40.585822 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86cb447-cb08-4b01-ad0c-3a0f4eeb78d1 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:40.600360 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application [None req-c86cb447-cb08-4b01-ad0c-3a0f4eeb78d1 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 27 08:27:40.600360 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:27:40.600360 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 08:27:40.600360 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 08:27:40.600360 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 08:27:40.600360 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 08:27:40.600360 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 08:27:40.600360 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 08:27:40.600360 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 27 08:27:40.600360 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application May 27 08:27:40.600360 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 08:27:40.600360 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application May 27 08:27:40.600360 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:27:40.600360 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:27:40.600360 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:27:40.600360 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:27:40.601500 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:27:40.601500 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:27:40.601500 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:27:40.601500 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:27:40.601500 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:27:40.601500 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:27:40.601500 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:27:40.601500 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 08:27:40.601500 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 08:27:40.601500 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 08:27:40.601500 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 08:27:40.601500 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:27:40.601500 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:27:40.601500 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:27:40.601500 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:27:40.601500 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:27:40.602435 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:27:40.602435 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:27:40.602435 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application with Lock( May 27 08:27:40.602435 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:27:40.602435 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._enter() May 27 08:27:40.602435 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:27:40.602435 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:27:40.602435 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:27:40.602435 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.creator() May 27 08:27:40.602435 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:27:40.602435 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application created_value = creator( May 27 08:27:40.602435 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 08:27:40.602435 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 08:27:40.602435 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 27 08:27:40.602435 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application May 27 08:27:40.605507 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 365/726] 10.222.0.62 () {56 vars in 1129 bytes} [Fri May 27 08:27:40 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 08:27:40.612633 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b946aee-d543-4e23-8354-d03698ccddfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:40.612633 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b946aee-d543-4e23-8354-d03698ccddfb None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:40.612633 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b946aee-d543-4e23-8354-d03698ccddfb None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:40.612633 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b946aee-d543-4e23-8354-d03698ccddfb None admin] PATH_INFO: `/v3/projects` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:40.613000 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b946aee-d543-4e23-8354-d03698ccddfb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:27:40.613000 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b946aee-d543-4e23-8354-d03698ccddfb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:40.613124 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86cb447-cb08-4b01-ad0c-3a0f4eeb78d1 None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:40.615024 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b946aee-d543-4e23-8354-d03698ccddfb None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:40.626972 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 362/727] 10.222.0.62 () {56 vars in 1148 bytes} [Fri May 27 08:27:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:27:40.638943 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b946aee-d543-4e23-8354-d03698ccddfb None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:40.669744 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:40.730522 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86cb447-cb08-4b01-ad0c-3a0f4eeb78d1 None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:40.758637 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b946aee-d543-4e23-8354-d03698ccddfb None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:40.768738 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e38d264-f83e-4481-b221-4a3aab133298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:40.769727 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e38d264-f83e-4481-b221-4a3aab133298 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:40.770022 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e38d264-f83e-4481-b221-4a3aab133298 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:40.770460 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e38d264-f83e-4481-b221-4a3aab133298 None admin] PATH_INFO: `/v3/services` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:40.771185 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e38d264-f83e-4481-b221-4a3aab133298 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:27:40.771497 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e38d264-f83e-4481-b221-4a3aab133298 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:40.772930 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e38d264-f83e-4481-b221-4a3aab133298 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:40.778176 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 366/728] 10.222.0.62 () {56 vars in 1124 bytes} [Fri May 27 08:27:40 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:27:40.779801 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babdf43c-947c-4ded-b86a-eab0fafac3a5 None None] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:40.780101 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babdf43c-947c-4ded-b86a-eab0fafac3a5 None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:40.780387 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babdf43c-947c-4ded-b86a-eab0fafac3a5 None None] PATH_INFO: `/` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:40.784727 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 367/729] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:27:40 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:27:40.786004 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babdf43c-947c-4ded-b86a-eab0fafac3a5 None None] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:40.804026 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ca42a9-0998-4eea-b602-08bb9c57b653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:40.805064 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ca42a9-0998-4eea-b602-08bb9c57b653 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:40.805671 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ca42a9-0998-4eea-b602-08bb9c57b653 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:40.806270 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ca42a9-0998-4eea-b602-08bb9c57b653 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:40.807913 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ca42a9-0998-4eea-b602-08bb9c57b653 None admin] RBAC: Adding query filter params (role.id=5e6f243a7201412c965e7c70249d4dc0, scope.project.id=256f4731060449f1b80067e51e8bec00, user.id=3a09bdc2dbac4f9abe450ff121e7dce8) {{(pid=87173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:27:40.808359 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ca42a9-0998-4eea-b602-08bb9c57b653 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:40.809875 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ca42a9-0998-4eea-b602-08bb9c57b653 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:40.817713 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 363/730] 10.222.0.62 () {56 vars in 1374 bytes} [Fri May 27 08:27:40 2022] GET /identity/v3/role_assignments?user.id=3a09bdc2dbac4f9abe450ff121e7dce8&scope.project.id=256f4731060449f1b80067e51e8bec00&role.id=5e6f243a7201412c965e7c70249d4dc0 => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 08:27:40.819061 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05552ba6-4222-40d9-bf90-00ff011db231 None None] REQUEST_METHOD: `POST` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:40.819343 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05552ba6-4222-40d9-bf90-00ff011db231 None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:40.819565 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05552ba6-4222-40d9-bf90-00ff011db231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:40.838711 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.auth.core [None req-05552ba6-4222-40d9-bf90-00ff011db231 None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:27:40.840057 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.fernet_utils [None req-05552ba6-4222-40d9-bf90-00ff011db231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:27:40.882022 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:40.937504 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 364/731] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:27:40 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 08:27:40.947675 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babdf43c-947c-4ded-b86a-eab0fafac3a5 None None] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:40.961603 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05552ba6-4222-40d9-bf90-00ff011db231 None None] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:40.978587 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:40.991288 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efecde87-268f-4048-955a-b80bdd57eb4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:40.992564 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efecde87-268f-4048-955a-b80bdd57eb4d None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:40.993114 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efecde87-268f-4048-955a-b80bdd57eb4d None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:40.993625 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efecde87-268f-4048-955a-b80bdd57eb4d None admin] PATH_INFO: `/v3/services` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:40.994688 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efecde87-268f-4048-955a-b80bdd57eb4d None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:27:40.995211 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efecde87-268f-4048-955a-b80bdd57eb4d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:40.996918 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efecde87-268f-4048-955a-b80bdd57eb4d None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:41.004063 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 368/732] 10.222.0.62 () {56 vars in 1124 bytes} [Fri May 27 08:27:40 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:27:41.012629 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efecde87-268f-4048-955a-b80bdd57eb4d None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:41.085062 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05552ba6-4222-40d9-bf90-00ff011db231 None None] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:41.136560 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059cb9e9-4253-4ab3-a60f-adf602530322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:41.139276 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059cb9e9-4253-4ab3-a60f-adf602530322 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:41.139564 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059cb9e9-4253-4ab3-a60f-adf602530322 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:41.139846 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059cb9e9-4253-4ab3-a60f-adf602530322 None admin] PATH_INFO: `/v3/services/image` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:41.140567 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059cb9e9-4253-4ab3-a60f-adf602530322 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:41.142129 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059cb9e9-4253-4ab3-a60f-adf602530322 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:41.151852 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efecde87-268f-4048-955a-b80bdd57eb4d None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:41.155102 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application [None req-059cb9e9-4253-4ab3-a60f-adf602530322 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 27 08:27:41.155102 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:27:41.155102 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 08:27:41.155102 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 08:27:41.155102 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 08:27:41.155102 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 08:27:41.155102 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 08:27:41.155102 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 08:27:41.155102 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 27 08:27:41.155102 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application May 27 08:27:41.155102 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 08:27:41.155102 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application May 27 08:27:41.155102 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:27:41.155102 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:27:41.155102 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:27:41.155102 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:27:41.155102 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:27:41.162834 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:27:41.162834 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:27:41.162834 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:27:41.162834 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:27:41.162834 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:27:41.162834 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:27:41.162834 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 08:27:41.162834 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 08:27:41.162834 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 08:27:41.162834 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 08:27:41.162834 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:27:41.162834 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:27:41.162834 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:27:41.162834 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:27:41.162834 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:27:41.162834 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:27:41.164575 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:27:41.164575 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application with Lock( May 27 08:27:41.164575 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:27:41.164575 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._enter() May 27 08:27:41.164575 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:27:41.164575 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:27:41.164575 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:27:41.164575 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.creator() May 27 08:27:41.164575 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:27:41.164575 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application created_value = creator( May 27 08:27:41.164575 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 08:27:41.164575 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 08:27:41.164575 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 27 08:27:41.164575 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application May 27 08:27:41.164575 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 365/733] 10.222.0.62 () {56 vars in 1105 bytes} [Fri May 27 08:27:40 2022] GET /identity/v3/services/image => generated 86 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 08:27:41.170606 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059cb9e9-4253-4ab3-a60f-adf602530322 None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:41.196966 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:41.212403 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1586e292-5ed6-40c5-b5e7-3278070e1a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:41.214057 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1586e292-5ed6-40c5-b5e7-3278070e1a59 None admin] REQUEST_METHOD: `POST` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:41.214453 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1586e292-5ed6-40c5-b5e7-3278070e1a59 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:41.214837 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1586e292-5ed6-40c5-b5e7-3278070e1a59 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:41.215692 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1586e292-5ed6-40c5-b5e7-3278070e1a59 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:41.217216 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1586e292-5ed6-40c5-b5e7-3278070e1a59 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:41.248227 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 369/734] 10.222.0.62 () {60 vars in 1144 bytes} [Fri May 27 08:27:41 2022] POST /identity/v3/endpoints => generated 346 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 08:27:41.283139 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:41.310962 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059cb9e9-4253-4ab3-a60f-adf602530322 None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:41.361285 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8800685f-8529-4bdb-890f-d6ddd65e54a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:41.361977 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8800685f-8529-4bdb-890f-d6ddd65e54a3 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:41.362271 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8800685f-8529-4bdb-890f-d6ddd65e54a3 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:41.362591 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8800685f-8529-4bdb-890f-d6ddd65e54a3 None admin] PATH_INFO: `/v3/services` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:41.363432 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8800685f-8529-4bdb-890f-d6ddd65e54a3 None admin] RBAC: Adding query filter params (name=image) {{(pid=87173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:27:41.363846 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8800685f-8529-4bdb-890f-d6ddd65e54a3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:41.365570 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8800685f-8529-4bdb-890f-d6ddd65e54a3 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:41.371887 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 366/735] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 08:27:41 2022] GET /identity/v3/services?name=image => generated 122 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:27:41.382320 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1586e292-5ed6-40c5-b5e7-3278070e1a59 None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:41.501024 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1586e292-5ed6-40c5-b5e7-3278070e1a59 None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:41.538615 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84d77d7-f060-41cb-8355-e996d4770ce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:41.539557 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84d77d7-f060-41cb-8355-e996d4770ce7 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:41.540003 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84d77d7-f060-41cb-8355-e996d4770ce7 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:41.540516 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84d77d7-f060-41cb-8355-e996d4770ce7 None admin] PATH_INFO: `/v3/services` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:41.541407 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84d77d7-f060-41cb-8355-e996d4770ce7 None admin] RBAC: Adding query filter params (type=image) {{(pid=87172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:27:41.541875 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84d77d7-f060-41cb-8355-e996d4770ce7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:41.542397 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe9425-2331-4b93-9323-11c0fd298c5d None None] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:41.542711 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe9425-2331-4b93-9323-11c0fd298c5d None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:41.542993 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe9425-2331-4b93-9323-11c0fd298c5d None None] PATH_INFO: `/` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:41.543413 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84d77d7-f060-41cb-8355-e996d4770ce7 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:41.544535 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 367/736] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:27:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:27:41.550965 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33375cf6-38dc-4e5b-a154-66b04966ea0a None None] REQUEST_METHOD: `POST` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:41.551549 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33375cf6-38dc-4e5b-a154-66b04966ea0a None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:41.552024 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33375cf6-38dc-4e5b-a154-66b04966ea0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:41.553481 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 370/737] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 08:27:41 2022] GET /identity/v3/services?type=image => generated 350 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:27:41.558857 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84d77d7-f060-41cb-8355-e996d4770ce7 None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:41.573774 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.auth.core [None req-33375cf6-38dc-4e5b-a154-66b04966ea0a None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:27:41.575343 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.fernet_utils [None req-33375cf6-38dc-4e5b-a154-66b04966ea0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:27:41.619213 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:41.664611 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 368/738] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:27:41 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 08:27:41.683622 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33375cf6-38dc-4e5b-a154-66b04966ea0a None None] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:41.693195 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84d77d7-f060-41cb-8355-e996d4770ce7 None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:41.730732 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24bb390-e4bf-463b-858a-9c3fb27d9421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:41.731746 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24bb390-e4bf-463b-858a-9c3fb27d9421 None admin] REQUEST_METHOD: `POST` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:41.732271 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24bb390-e4bf-463b-858a-9c3fb27d9421 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:41.732789 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24bb390-e4bf-463b-858a-9c3fb27d9421 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:41.733794 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24bb390-e4bf-463b-858a-9c3fb27d9421 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:41.735858 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24bb390-e4bf-463b-858a-9c3fb27d9421 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:41.760489 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 371/739] 10.222.0.62 () {60 vars in 1144 bytes} [Fri May 27 08:27:41 2022] POST /identity/v3/endpoints => generated 327 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 08:27:41.774622 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:41.821682 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33375cf6-38dc-4e5b-a154-66b04966ea0a None None] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:41.876144 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a13e78-4a83-4bad-b866-207cc5924da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:41.877390 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a13e78-4a83-4bad-b866-207cc5924da2 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:41.877880 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a13e78-4a83-4bad-b866-207cc5924da2 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:41.878371 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a13e78-4a83-4bad-b866-207cc5924da2 None admin] PATH_INFO: `/v3/services/network` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:41.879259 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a13e78-4a83-4bad-b866-207cc5924da2 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:41.881012 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a13e78-4a83-4bad-b866-207cc5924da2 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:41.895810 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application [None req-90a13e78-4a83-4bad-b866-207cc5924da2 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 27 08:27:41.895810 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:27:41.895810 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 08:27:41.895810 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 08:27:41.895810 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 08:27:41.895810 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 08:27:41.895810 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 08:27:41.895810 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 08:27:41.895810 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 27 08:27:41.895810 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application May 27 08:27:41.895810 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 08:27:41.895810 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application May 27 08:27:41.895810 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:27:41.895810 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:27:41.895810 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:27:41.895810 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:27:41.895810 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:27:41.896987 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:27:41.896987 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:27:41.896987 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:27:41.896987 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:27:41.896987 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:27:41.896987 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:27:41.896987 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 08:27:41.896987 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 08:27:41.896987 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 08:27:41.896987 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 08:27:41.896987 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:27:41.896987 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:27:41.896987 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:27:41.896987 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:27:41.896987 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:27:41.896987 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:27:41.897900 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:27:41.897900 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application with Lock( May 27 08:27:41.897900 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:27:41.897900 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._enter() May 27 08:27:41.897900 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:27:41.897900 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:27:41.897900 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:27:41.897900 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.creator() May 27 08:27:41.897900 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:27:41.897900 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application created_value = creator( May 27 08:27:41.897900 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 08:27:41.897900 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 08:27:41.897900 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 27 08:27:41.897900 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application May 27 08:27:41.900971 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 369/740] 10.222.0.62 () {56 vars in 1111 bytes} [Fri May 27 08:27:41 2022] GET /identity/v3/services/network => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 08:27:41.909077 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24bb390-e4bf-463b-858a-9c3fb27d9421 None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:42.021802 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:42.025449 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24bb390-e4bf-463b-858a-9c3fb27d9421 None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:42.065073 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d605f6-028f-48ce-a6ee-60ee9aa41bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:42.065773 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d605f6-028f-48ce-a6ee-60ee9aa41bee None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:42.066021 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d605f6-028f-48ce-a6ee-60ee9aa41bee None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:42.066299 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d605f6-028f-48ce-a6ee-60ee9aa41bee None admin] PATH_INFO: `/v3/services` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:42.067021 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d605f6-028f-48ce-a6ee-60ee9aa41bee None admin] RBAC: Adding query filter params (name=network) {{(pid=87172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:27:42.067327 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d605f6-028f-48ce-a6ee-60ee9aa41bee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:42.068737 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d605f6-028f-48ce-a6ee-60ee9aa41bee None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:42.074147 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 372/741] 10.222.0.62 () {56 vars in 1112 bytes} [Fri May 27 08:27:41 2022] GET /identity/v3/services?name=network => generated 124 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:27:42.079898 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a13e78-4a83-4bad-b866-207cc5924da2 None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:42.196055 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a13e78-4a83-4bad-b866-207cc5924da2 None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:42.225851 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:42.235880 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d32a69-d9b6-4188-b6ea-b3f275915e30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:42.236553 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d32a69-d9b6-4188-b6ea-b3f275915e30 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:42.236868 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d32a69-d9b6-4188-b6ea-b3f275915e30 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:42.237147 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d32a69-d9b6-4188-b6ea-b3f275915e30 None admin] PATH_INFO: `/v3/services` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:42.237869 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d32a69-d9b6-4188-b6ea-b3f275915e30 None admin] RBAC: Adding query filter params (type=network) {{(pid=87173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:27:42.238176 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d32a69-d9b6-4188-b6ea-b3f275915e30 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:42.239577 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d32a69-d9b6-4188-b6ea-b3f275915e30 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:42.245782 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 370/742] 10.222.0.62 () {56 vars in 1112 bytes} [Fri May 27 08:27:42 2022] GET /identity/v3/services?type=network => generated 350 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 08:27:42.251361 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d605f6-028f-48ce-a6ee-60ee9aa41bee None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:42.358741 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d605f6-028f-48ce-a6ee-60ee9aa41bee None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:42.395393 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4441d6-7988-41df-acd3-57b220dd8885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:42.396147 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4441d6-7988-41df-acd3-57b220dd8885 None admin] REQUEST_METHOD: `POST` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:42.396347 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4441d6-7988-41df-acd3-57b220dd8885 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:42.396617 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4441d6-7988-41df-acd3-57b220dd8885 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:42.397377 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4441d6-7988-41df-acd3-57b220dd8885 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:42.398754 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4441d6-7988-41df-acd3-57b220dd8885 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:42.422212 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 373/743] 10.222.0.62 () {60 vars in 1144 bytes} [Fri May 27 08:27:42 2022] POST /identity/v3/endpoints => generated 327 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 08:27:43.317070 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25028329-0a32-417d-8b10-32482b3a04fa None None] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:43.317726 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25028329-0a32-417d-8b10-32482b3a04fa None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:43.317726 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25028329-0a32-417d-8b10-32482b3a04fa None None] PATH_INFO: `/` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:43.319410 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 371/744] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:27:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:27:43.324793 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f210ee62-59c7-4b0a-950c-f848d21bb9ea None None] REQUEST_METHOD: `POST` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:43.325281 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f210ee62-59c7-4b0a-950c-f848d21bb9ea None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:43.325381 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f210ee62-59c7-4b0a-950c-f848d21bb9ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:43.344102 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.auth.core [None req-f210ee62-59c7-4b0a-950c-f848d21bb9ea None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:27:43.345426 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.fernet_utils [None req-f210ee62-59c7-4b0a-950c-f848d21bb9ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:27:43.362930 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:43.435887 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 374/745] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:27:43 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 08:27:43.460678 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25028329-0a32-417d-8b10-32482b3a04fa None None] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:43.587647 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25028329-0a32-417d-8b10-32482b3a04fa None None] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:43.627059 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edea5218-8f75-421f-959b-9e071450ceba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:43.627869 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edea5218-8f75-421f-959b-9e071450ceba None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:43.628155 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edea5218-8f75-421f-959b-9e071450ceba None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:43.628491 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edea5218-8f75-421f-959b-9e071450ceba None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:43.629354 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edea5218-8f75-421f-959b-9e071450ceba None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:43.631892 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edea5218-8f75-421f-959b-9e071450ceba None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:43.647767 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application [None req-edea5218-8f75-421f-959b-9e071450ceba None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 27 08:27:43.647767 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:27:43.647767 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 08:27:43.647767 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 08:27:43.647767 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 08:27:43.647767 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 08:27:43.647767 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 08:27:43.647767 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 08:27:43.647767 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 27 08:27:43.647767 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application May 27 08:27:43.647767 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 08:27:43.647767 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application May 27 08:27:43.647767 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:27:43.647767 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:27:43.647767 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:27:43.647767 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:27:43.648746 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:27:43.648746 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:27:43.648746 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:27:43.648746 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:27:43.648746 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:27:43.648746 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:27:43.648746 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:27:43.648746 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 08:27:43.648746 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 08:27:43.648746 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 08:27:43.648746 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 08:27:43.648746 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:27:43.648746 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:27:43.648746 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:27:43.648746 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:27:43.648746 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:27:43.655890 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:27:43.655890 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:27:43.655890 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application with Lock( May 27 08:27:43.655890 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:27:43.655890 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._enter() May 27 08:27:43.655890 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:27:43.655890 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:27:43.655890 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:27:43.655890 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.creator() May 27 08:27:43.655890 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:27:43.655890 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application created_value = creator( May 27 08:27:43.655890 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 08:27:43.655890 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 08:27:43.655890 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 27 08:27:43.655890 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application May 27 08:27:43.655890 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 372/746] 10.222.0.62 () {56 vars in 1132 bytes} [Fri May 27 08:27:43 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 08:27:43.656798 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f210ee62-59c7-4b0a-950c-f848d21bb9ea None None] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:43.755979 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126e6304-f95e-4513-ace3-c76fad3550a6 None None] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:43.756419 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126e6304-f95e-4513-ace3-c76fad3550a6 None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:43.757013 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126e6304-f95e-4513-ace3-c76fad3550a6 None None] PATH_INFO: `/` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:43.759255 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 373/747] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:27:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:27:43.765370 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e6e52b-7bac-49ae-bc06-6256f28a405a None None] REQUEST_METHOD: `POST` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:43.766133 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e6e52b-7bac-49ae-bc06-6256f28a405a None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:43.766398 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e6e52b-7bac-49ae-bc06-6256f28a405a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:43.783432 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.auth.core [None req-f9e6e52b-7bac-49ae-bc06-6256f28a405a None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:27:43.784686 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.fernet_utils [None req-f9e6e52b-7bac-49ae-bc06-6256f28a405a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:27:43.788154 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f210ee62-59c7-4b0a-950c-f848d21bb9ea None None] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:43.832410 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97af9cc3-ff4c-4565-9ac5-ccc753be1e4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:43.833137 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97af9cc3-ff4c-4565-9ac5-ccc753be1e4f None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:43.833531 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97af9cc3-ff4c-4565-9ac5-ccc753be1e4f None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:43.834427 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97af9cc3-ff4c-4565-9ac5-ccc753be1e4f None admin] PATH_INFO: `/v3/services` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:43.835258 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97af9cc3-ff4c-4565-9ac5-ccc753be1e4f None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:27:43.835565 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97af9cc3-ff4c-4565-9ac5-ccc753be1e4f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:43.837960 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97af9cc3-ff4c-4565-9ac5-ccc753be1e4f None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:43.853311 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:43.853506 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 375/748] 10.222.0.62 () {56 vars in 1126 bytes} [Fri May 27 08:27:43 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:27:43.853710 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97af9cc3-ff4c-4565-9ac5-ccc753be1e4f None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:43.872972 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 374/749] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:27:43 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 08:27:43.877357 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:43.895493 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e6e52b-7bac-49ae-bc06-6256f28a405a None None] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:43.987329 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97af9cc3-ff4c-4565-9ac5-ccc753be1e4f None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:44.028465 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e6e52b-7bac-49ae-bc06-6256f28a405a None None] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:44.028694 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c5b293-e22a-4a7b-86a2-475da759ff4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:44.029386 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c5b293-e22a-4a7b-86a2-475da759ff4e None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:44.029673 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c5b293-e22a-4a7b-86a2-475da759ff4e None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:44.029956 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c5b293-e22a-4a7b-86a2-475da759ff4e None admin] PATH_INFO: `/v3/services` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:44.030728 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c5b293-e22a-4a7b-86a2-475da759ff4e None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:27:44.031780 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c5b293-e22a-4a7b-86a2-475da759ff4e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:44.033417 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c5b293-e22a-4a7b-86a2-475da759ff4e None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:44.038742 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 376/750] 10.222.0.62 () {56 vars in 1126 bytes} [Fri May 27 08:27:43 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:27:44.079997 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3278f756-6dc0-46bc-8763-fa3a2bc053f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:44.081677 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3278f756-6dc0-46bc-8763-fa3a2bc053f7 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:44.082196 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3278f756-6dc0-46bc-8763-fa3a2bc053f7 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:44.082750 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3278f756-6dc0-46bc-8763-fa3a2bc053f7 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:44.083779 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3278f756-6dc0-46bc-8763-fa3a2bc053f7 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:44.085496 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3278f756-6dc0-46bc-8763-fa3a2bc053f7 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:44.099949 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application [None req-3278f756-6dc0-46bc-8763-fa3a2bc053f7 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 27 08:27:44.099949 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:27:44.099949 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 08:27:44.099949 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 08:27:44.099949 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 08:27:44.099949 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 08:27:44.099949 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 08:27:44.099949 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 08:27:44.099949 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 27 08:27:44.099949 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application May 27 08:27:44.099949 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 08:27:44.099949 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application May 27 08:27:44.099949 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:27:44.099949 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:27:44.099949 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:27:44.099949 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:27:44.099949 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:27:44.101178 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:27:44.101178 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:27:44.101178 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:27:44.101178 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:27:44.101178 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:27:44.101178 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:27:44.101178 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 08:27:44.101178 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 08:27:44.101178 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 08:27:44.101178 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 08:27:44.101178 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:27:44.101178 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:27:44.101178 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:27:44.101178 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:27:44.101178 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:27:44.101178 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:27:44.102233 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:27:44.102233 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application with Lock( May 27 08:27:44.102233 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:27:44.102233 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._enter() May 27 08:27:44.102233 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:27:44.102233 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:27:44.102233 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:27:44.102233 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.creator() May 27 08:27:44.102233 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:27:44.102233 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application created_value = creator( May 27 08:27:44.102233 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 08:27:44.102233 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 08:27:44.102233 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 27 08:27:44.102233 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application May 27 08:27:44.104654 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 375/751] 10.222.0.62 () {56 vars in 1114 bytes} [Fri May 27 08:27:43 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 08:27:44.113408 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c5b293-e22a-4a7b-86a2-475da759ff4e None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:44.205624 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:44.238630 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c5b293-e22a-4a7b-86a2-475da759ff4e None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:44.269736 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2316d041-6e23-425e-ae90-3b3d69095c75 None None] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:44.270021 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2316d041-6e23-425e-ae90-3b3d69095c75 None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:44.270297 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2316d041-6e23-425e-ae90-3b3d69095c75 None None] PATH_INFO: `/` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:44.271703 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 376/752] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:27:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 08:27:44.277386 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888e3df9-86c0-47d7-a232-ba099d2a88ff None None] REQUEST_METHOD: `POST` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:44.277579 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888e3df9-86c0-47d7-a232-ba099d2a88ff None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:44.277901 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888e3df9-86c0-47d7-a232-ba099d2a88ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:44.286504 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00332ef9-7eb0-405b-8dc3-06c90695e36a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:44.287530 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00332ef9-7eb0-405b-8dc3-06c90695e36a None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:44.288013 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00332ef9-7eb0-405b-8dc3-06c90695e36a None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:44.288503 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00332ef9-7eb0-405b-8dc3-06c90695e36a None admin] PATH_INFO: `/v3/services` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:44.289462 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00332ef9-7eb0-405b-8dc3-06c90695e36a None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:27:44.289967 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00332ef9-7eb0-405b-8dc3-06c90695e36a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:44.291576 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00332ef9-7eb0-405b-8dc3-06c90695e36a None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:44.296748 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.auth.core [None req-888e3df9-86c0-47d7-a232-ba099d2a88ff None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:27:44.298091 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 377/753] 10.222.0.62 () {56 vars in 1114 bytes} [Fri May 27 08:27:44 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:27:44.299361 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.fernet_utils [None req-888e3df9-86c0-47d7-a232-ba099d2a88ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:27:44.303503 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00332ef9-7eb0-405b-8dc3-06c90695e36a None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:44.361775 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:44.397967 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 377/754] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:27:44 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 08:27:44.425298 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888e3df9-86c0-47d7-a232-ba099d2a88ff None None] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:44.434787 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00332ef9-7eb0-405b-8dc3-06c90695e36a None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:44.487880 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da7a65c-1f32-4968-b00b-b83d898368e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:44.488678 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da7a65c-1f32-4968-b00b-b83d898368e7 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:44.489033 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da7a65c-1f32-4968-b00b-b83d898368e7 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:44.489510 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da7a65c-1f32-4968-b00b-b83d898368e7 None admin] PATH_INFO: `/v3/services` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:44.490036 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da7a65c-1f32-4968-b00b-b83d898368e7 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:27:44.490328 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da7a65c-1f32-4968-b00b-b83d898368e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:44.491702 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da7a65c-1f32-4968-b00b-b83d898368e7 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:44.497389 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 378/755] 10.222.0.62 () {56 vars in 1114 bytes} [Fri May 27 08:27:44 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:27:44.571582 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888e3df9-86c0-47d7-a232-ba099d2a88ff None None] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:44.619435 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c774332b-76f8-4d11-a8a6-0c348ddcf049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:44.620027 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c774332b-76f8-4d11-a8a6-0c348ddcf049 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:44.620317 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c774332b-76f8-4d11-a8a6-0c348ddcf049 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:44.620623 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c774332b-76f8-4d11-a8a6-0c348ddcf049 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:44.694213 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:44.720180 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c774332b-76f8-4d11-a8a6-0c348ddcf049 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:44.722708 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c774332b-76f8-4d11-a8a6-0c348ddcf049 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:44.848005 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 378/756] 10.222.0.62 () {58 vars in 1282 bytes} [Fri May 27 08:27:44 2022] GET /identity/v3/auth/tokens => generated 1396 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 27 08:27:44.853575 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da7a65c-1f32-4968-b00b-b83d898368e7 None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:44.856566 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:45.004995 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da7a65c-1f32-4968-b00b-b83d898368e7 None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:45.043763 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4f37e7-36b2-41a0-8bf5-f68a72615ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:45.044577 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4f37e7-36b2-41a0-8bf5-f68a72615ca7 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:45.044883 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4f37e7-36b2-41a0-8bf5-f68a72615ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:45.045159 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4f37e7-36b2-41a0-8bf5-f68a72615ca7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:45.059995 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4f37e7-36b2-41a0-8bf5-f68a72615ca7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:45.061525 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4f37e7-36b2-41a0-8bf5-f68a72615ca7 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:45.083203 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application [None req-5d4f37e7-36b2-41a0-8bf5-f68a72615ca7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 08:27:45.083203 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:27:45.083203 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:27:45.083203 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:27:45.083203 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:27:45.083203 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:27:45.083203 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:27:45.083203 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:27:45.083203 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:27:45.083203 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:27:45.083203 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:27:45.083203 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:27:45.083203 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 08:27:45.083203 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 08:27:45.083203 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 08:27:45.084303 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 08:27:45.084303 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:27:45.084303 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:27:45.084303 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:27:45.084303 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:27:45.084303 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:27:45.084303 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:27:45.084303 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:27:45.084303 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application with Lock( May 27 08:27:45.084303 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:27:45.084303 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._enter() May 27 08:27:45.084303 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:27:45.084303 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:27:45.084303 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:27:45.084303 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.creator() May 27 08:27:45.084303 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:27:45.084303 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application created_value = creator( May 27 08:27:45.085361 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 08:27:45.085361 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 08:27:45.085361 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 08:27:45.085361 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application May 27 08:27:45.088957 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 379/757] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 08:27:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 08:27:45.091653 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c774332b-76f8-4d11-a8a6-0c348ddcf049 None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:45.188870 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:45.217093 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c774332b-76f8-4d11-a8a6-0c348ddcf049 None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:45.263428 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef7db94-37b7-41bc-9c48-46a2e347ec8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:45.264038 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef7db94-37b7-41bc-9c48-46a2e347ec8a None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:45.264312 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef7db94-37b7-41bc-9c48-46a2e347ec8a None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:45.264632 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef7db94-37b7-41bc-9c48-46a2e347ec8a None admin] PATH_INFO: `/v3/domains` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:45.265531 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef7db94-37b7-41bc-9c48-46a2e347ec8a None admin] RBAC: Adding query filter params (name=Default) {{(pid=87173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:27:45.265946 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef7db94-37b7-41bc-9c48-46a2e347ec8a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:45.267555 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef7db94-37b7-41bc-9c48-46a2e347ec8a None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:45.288618 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 379/758] 10.222.0.62 () {56 vars in 1109 bytes} [Fri May 27 08:27:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:27:46.411913 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3928cb8-82c9-4055-b3a2-d202c866a241 None None] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:46.412469 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3928cb8-82c9-4055-b3a2-d202c866a241 None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:46.412469 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3928cb8-82c9-4055-b3a2-d202c866a241 None None] PATH_INFO: `/` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:46.413856 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 380/759] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:27:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:27:46.419112 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8add0a-c371-49fd-89bc-aba216d323f0 None None] REQUEST_METHOD: `POST` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:46.419541 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8add0a-c371-49fd-89bc-aba216d323f0 None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:46.419650 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8add0a-c371-49fd-89bc-aba216d323f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:46.436779 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.auth.core [None req-5f8add0a-c371-49fd-89bc-aba216d323f0 None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:27:46.438536 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.fernet_utils [None req-5f8add0a-c371-49fd-89bc-aba216d323f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:27:46.504912 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 380/760] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:27:46 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 08:27:46.528137 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3928cb8-82c9-4055-b3a2-d202c866a241 None None] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:46.599765 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:46.654155 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3928cb8-82c9-4055-b3a2-d202c866a241 None None] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:46.699653 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b400360c-7381-41dc-ab01-bcbef8d837aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:46.700119 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b400360c-7381-41dc-ab01-bcbef8d837aa None admin] REQUEST_METHOD: `POST` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:46.700401 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b400360c-7381-41dc-ab01-bcbef8d837aa None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:46.701192 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b400360c-7381-41dc-ab01-bcbef8d837aa None admin] PATH_INFO: `/v3/services` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:46.701944 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b400360c-7381-41dc-ab01-bcbef8d837aa None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:46.703832 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b400360c-7381-41dc-ab01-bcbef8d837aa None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:46.728631 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 381/761] 10.222.0.62 () {60 vars in 1141 bytes} [Fri May 27 08:27:46 2022] POST /identity/v3/services => generated 269 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 08:27:46.860830 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816dd07f-fb8b-4975-9d70-c602a5be58d1 None None] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:46.861113 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816dd07f-fb8b-4975-9d70-c602a5be58d1 None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:46.861404 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816dd07f-fb8b-4975-9d70-c602a5be58d1 None None] PATH_INFO: `/` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:46.862862 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 381/762] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:27:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:27:46.868946 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315d1e8b-91df-4619-a900-520277f59239 None None] REQUEST_METHOD: `POST` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:46.869240 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315d1e8b-91df-4619-a900-520277f59239 None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:46.869519 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315d1e8b-91df-4619-a900-520277f59239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:46.888671 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.auth.core [None req-315d1e8b-91df-4619-a900-520277f59239 None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:27:46.889911 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.fernet_utils [None req-315d1e8b-91df-4619-a900-520277f59239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:27:46.965862 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 382/763] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:27:46 2022] POST /identity/v3/auth/tokens => generated 1506 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 08:27:46.990247 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816dd07f-fb8b-4975-9d70-c602a5be58d1 None None] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:47.062481 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:47.096014 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816dd07f-fb8b-4975-9d70-c602a5be58d1 None None] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:47.131040 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013733b4-e87d-4022-a04f-0fe388d1e44e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:47.131700 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013733b4-e87d-4022-a04f-0fe388d1e44e None admin] REQUEST_METHOD: `POST` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:47.131985 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013733b4-e87d-4022-a04f-0fe388d1e44e None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:47.132264 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013733b4-e87d-4022-a04f-0fe388d1e44e None admin] PATH_INFO: `/v3/services` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:47.133046 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013733b4-e87d-4022-a04f-0fe388d1e44e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:47.134449 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013733b4-e87d-4022-a04f-0fe388d1e44e None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:47.156855 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 382/764] 10.222.0.62 () {60 vars in 1141 bytes} [Fri May 27 08:27:46 2022] POST /identity/v3/services => generated 251 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 08:27:49.056036 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a358995-046d-4498-9656-a2a166b9117f None None] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:49.056583 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a358995-046d-4498-9656-a2a166b9117f None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:49.056583 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a358995-046d-4498-9656-a2a166b9117f None None] PATH_INFO: `/` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:49.057983 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 383/765] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:27:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:27:49.063926 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725688fa-071c-4b09-9dc3-6434efbf6d33 None None] REQUEST_METHOD: `POST` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:49.064456 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725688fa-071c-4b09-9dc3-6434efbf6d33 None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:49.064456 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725688fa-071c-4b09-9dc3-6434efbf6d33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:49.081715 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.auth.core [None req-725688fa-071c-4b09-9dc3-6434efbf6d33 None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:27:49.082935 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.fernet_utils [None req-725688fa-071c-4b09-9dc3-6434efbf6d33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:27:49.158853 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 383/766] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:27:49 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 08:27:49.183558 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a358995-046d-4498-9656-a2a166b9117f None None] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:49.229578 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:49.295481 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a358995-046d-4498-9656-a2a166b9117f None None] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:49.330270 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7898498c-cb4c-4b00-806c-ae42b0dacc86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:49.331109 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7898498c-cb4c-4b00-806c-ae42b0dacc86 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:49.331401 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7898498c-cb4c-4b00-806c-ae42b0dacc86 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:49.331681 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7898498c-cb4c-4b00-806c-ae42b0dacc86 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:49.332341 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7898498c-cb4c-4b00-806c-ae42b0dacc86 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:49.333764 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7898498c-cb4c-4b00-806c-ae42b0dacc86 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:49.345971 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application [None req-7898498c-cb4c-4b00-806c-ae42b0dacc86 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 27 08:27:49.345971 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:27:49.345971 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 08:27:49.345971 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 08:27:49.345971 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 08:27:49.345971 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 08:27:49.345971 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 08:27:49.345971 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 08:27:49.345971 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 27 08:27:49.345971 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application May 27 08:27:49.345971 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 08:27:49.345971 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application May 27 08:27:49.345971 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:27:49.345971 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:27:49.345971 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:27:49.345971 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:27:49.347153 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:27:49.347153 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:27:49.347153 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:27:49.347153 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:27:49.347153 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:27:49.347153 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:27:49.347153 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:27:49.347153 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 08:27:49.347153 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 08:27:49.347153 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 08:27:49.347153 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 08:27:49.347153 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:27:49.347153 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:27:49.347153 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:27:49.347153 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:27:49.347153 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:27:49.348164 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:27:49.348164 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:27:49.348164 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application with Lock( May 27 08:27:49.348164 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:27:49.348164 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._enter() May 27 08:27:49.348164 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:27:49.348164 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:27:49.348164 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:27:49.348164 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.creator() May 27 08:27:49.348164 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:27:49.348164 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application created_value = creator( May 27 08:27:49.348164 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 08:27:49.348164 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 08:27:49.348164 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 27 08:27:49.348164 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application May 27 08:27:49.349389 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 384/767] 10.222.0.62 () {56 vars in 1132 bytes} [Fri May 27 08:27:49 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 08:27:49.354757 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725688fa-071c-4b09-9dc3-6434efbf6d33 None None] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:49.413819 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:49.459492 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725688fa-071c-4b09-9dc3-6434efbf6d33 None None] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:49.463196 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5a5bbc-6984-4dfc-b648-5a97f531227f None None] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:49.463490 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5a5bbc-6984-4dfc-b648-5a97f531227f None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:49.463782 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5a5bbc-6984-4dfc-b648-5a97f531227f None None] PATH_INFO: `/` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:49.465174 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 385/768] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:27:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 08:27:49.471093 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755c1cb7-62d8-4b28-bb47-54930cd598c9 None None] REQUEST_METHOD: `POST` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:49.471395 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755c1cb7-62d8-4b28-bb47-54930cd598c9 None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:49.471680 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755c1cb7-62d8-4b28-bb47-54930cd598c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:49.489638 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.auth.core [None req-755c1cb7-62d8-4b28-bb47-54930cd598c9 None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:27:49.490847 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.fernet_utils [None req-755c1cb7-62d8-4b28-bb47-54930cd598c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:27:49.494623 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13542c8b-c398-4d7c-9119-1d23e890cb03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:49.495282 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13542c8b-c398-4d7c-9119-1d23e890cb03 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:49.495562 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13542c8b-c398-4d7c-9119-1d23e890cb03 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:49.495836 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13542c8b-c398-4d7c-9119-1d23e890cb03 None admin] PATH_INFO: `/v3/services` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:49.496539 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13542c8b-c398-4d7c-9119-1d23e890cb03 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:27:49.496876 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13542c8b-c398-4d7c-9119-1d23e890cb03 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:49.498272 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13542c8b-c398-4d7c-9119-1d23e890cb03 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:49.504038 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 384/769] 10.222.0.62 () {56 vars in 1126 bytes} [Fri May 27 08:27:49 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:27:49.509808 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13542c8b-c398-4d7c-9119-1d23e890cb03 None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:49.559516 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 386/770] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:27:49 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 08:27:49.583690 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755c1cb7-62d8-4b28-bb47-54930cd598c9 None None] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:49.610091 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13542c8b-c398-4d7c-9119-1d23e890cb03 None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:49.619790 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:49.631472 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:49.649427 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e29d09-df63-49af-80d2-117d03967f53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:49.650094 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e29d09-df63-49af-80d2-117d03967f53 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:49.650372 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e29d09-df63-49af-80d2-117d03967f53 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:49.650763 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e29d09-df63-49af-80d2-117d03967f53 None admin] PATH_INFO: `/v3/services` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:49.651359 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e29d09-df63-49af-80d2-117d03967f53 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:27:49.651669 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e29d09-df63-49af-80d2-117d03967f53 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:49.653089 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e29d09-df63-49af-80d2-117d03967f53 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:49.658271 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 385/771] 10.222.0.62 () {56 vars in 1126 bytes} [Fri May 27 08:27:49 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 08:27:49.664259 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e29d09-df63-49af-80d2-117d03967f53 None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:49.694533 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755c1cb7-62d8-4b28-bb47-54930cd598c9 None None] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:49.729697 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483d70f3-6ca4-4834-abb0-057033d1a4b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:49.730492 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483d70f3-6ca4-4834-abb0-057033d1a4b0 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:49.730774 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483d70f3-6ca4-4834-abb0-057033d1a4b0 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:49.731052 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483d70f3-6ca4-4834-abb0-057033d1a4b0 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:49.731699 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483d70f3-6ca4-4834-abb0-057033d1a4b0 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:49.733128 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483d70f3-6ca4-4834-abb0-057033d1a4b0 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:49.745237 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application [None req-483d70f3-6ca4-4834-abb0-057033d1a4b0 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 27 08:27:49.745237 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:27:49.745237 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 08:27:49.745237 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 08:27:49.745237 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 08:27:49.745237 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 08:27:49.745237 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 08:27:49.745237 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 08:27:49.745237 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 27 08:27:49.745237 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application May 27 08:27:49.745237 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 08:27:49.745237 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application May 27 08:27:49.745237 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:27:49.745237 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:27:49.745237 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:27:49.745237 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:27:49.745237 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:27:49.746256 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:27:49.746256 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:27:49.746256 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:27:49.746256 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:27:49.746256 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:27:49.746256 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:27:49.746256 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 08:27:49.746256 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 08:27:49.746256 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 08:27:49.746256 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 08:27:49.746256 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:27:49.746256 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:27:49.746256 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:27:49.746256 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:27:49.746256 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:27:49.746256 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:27:49.747092 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:27:49.747092 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application with Lock( May 27 08:27:49.747092 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:27:49.747092 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._enter() May 27 08:27:49.747092 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:27:49.747092 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:27:49.747092 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:27:49.747092 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.creator() May 27 08:27:49.747092 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:27:49.747092 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application created_value = creator( May 27 08:27:49.747092 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 08:27:49.747092 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 08:27:49.747092 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 27 08:27:49.747092 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application May 27 08:27:49.747092 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 387/772] 10.222.0.62 () {56 vars in 1114 bytes} [Fri May 27 08:27:49 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 08:27:49.754349 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483d70f3-6ca4-4834-abb0-057033d1a4b0 None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:49.765760 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e29d09-df63-49af-80d2-117d03967f53 None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:49.800757 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511c74ea-8056-45a6-be9f-b93f5ce5260b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:49.801420 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511c74ea-8056-45a6-be9f-b93f5ce5260b None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:49.801707 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511c74ea-8056-45a6-be9f-b93f5ce5260b None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:49.801993 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511c74ea-8056-45a6-be9f-b93f5ce5260b None admin] PATH_INFO: `/v3/endpoints` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:49.802783 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511c74ea-8056-45a6-be9f-b93f5ce5260b None admin] RBAC: Adding query filter params (interface=public, service_id=10c6e955d6504e40a843699806e59242, region_id=RegionOne) {{(pid=87173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:27:49.803098 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511c74ea-8056-45a6-be9f-b93f5ce5260b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:49.804486 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511c74ea-8056-45a6-be9f-b93f5ce5260b None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:49.809535 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 386/773] 10.222.0.62 () {56 vars in 1251 bytes} [Fri May 27 08:27:49 2022] GET /identity/v3/endpoints?service_id=10c6e955d6504e40a843699806e59242&interface=public®ion_id=RegionOne => generated 194 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 08:27:49.815270 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511c74ea-8056-45a6-be9f-b93f5ce5260b None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:49.860631 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:49.864663 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483d70f3-6ca4-4834-abb0-057033d1a4b0 None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:49.866873 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:49.903764 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed990c8-33f8-42df-9a7e-6c7bdb4c1f8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:49.904436 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed990c8-33f8-42df-9a7e-6c7bdb4c1f8d None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:49.906062 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed990c8-33f8-42df-9a7e-6c7bdb4c1f8d None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:49.906062 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed990c8-33f8-42df-9a7e-6c7bdb4c1f8d None admin] PATH_INFO: `/v3/services` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:49.906575 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed990c8-33f8-42df-9a7e-6c7bdb4c1f8d None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:27:49.906893 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed990c8-33f8-42df-9a7e-6c7bdb4c1f8d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:49.908290 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed990c8-33f8-42df-9a7e-6c7bdb4c1f8d None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:49.915931 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 388/774] 10.222.0.62 () {56 vars in 1114 bytes} [Fri May 27 08:27:49 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 08:27:49.922454 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511c74ea-8056-45a6-be9f-b93f5ce5260b None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:49.922761 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed990c8-33f8-42df-9a7e-6c7bdb4c1f8d None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:49.956471 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa950692-1de0-4f75-808b-e5fd89cbfa13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:49.957167 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa950692-1de0-4f75-808b-e5fd89cbfa13 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:49.957453 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa950692-1de0-4f75-808b-e5fd89cbfa13 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:49.957738 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa950692-1de0-4f75-808b-e5fd89cbfa13 None admin] PATH_INFO: `/v3/services` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:49.958412 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa950692-1de0-4f75-808b-e5fd89cbfa13 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:49.959805 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa950692-1de0-4f75-808b-e5fd89cbfa13 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:49.965752 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 387/775] 10.222.0.62 () {56 vars in 1087 bytes} [Fri May 27 08:27:49 2022] GET /identity/v3/services => generated 1498 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 08:27:50.028026 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed990c8-33f8-42df-9a7e-6c7bdb4c1f8d None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:50.076211 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2fc4a5-616a-4899-a6ea-fd59f95ffa15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:50.076957 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2fc4a5-616a-4899-a6ea-fd59f95ffa15 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:50.077198 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2fc4a5-616a-4899-a6ea-fd59f95ffa15 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:50.078234 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2fc4a5-616a-4899-a6ea-fd59f95ffa15 None admin] PATH_INFO: `/v3/services` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:50.078849 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2fc4a5-616a-4899-a6ea-fd59f95ffa15 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:27:50.079160 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2fc4a5-616a-4899-a6ea-fd59f95ffa15 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:50.080625 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2fc4a5-616a-4899-a6ea-fd59f95ffa15 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:50.086566 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 389/776] 10.222.0.62 () {56 vars in 1114 bytes} [Fri May 27 08:27:49 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 08:27:50.092502 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa950692-1de0-4f75-808b-e5fd89cbfa13 None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:50.204876 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa950692-1de0-4f75-808b-e5fd89cbfa13 None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:50.218878 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:50.241560 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3056ad44-71be-49c3-b3eb-aae5c306591a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:50.242220 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3056ad44-71be-49c3-b3eb-aae5c306591a None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:50.242499 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3056ad44-71be-49c3-b3eb-aae5c306591a None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:50.242776 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3056ad44-71be-49c3-b3eb-aae5c306591a None admin] PATH_INFO: `/v3/endpoints` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:50.243642 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3056ad44-71be-49c3-b3eb-aae5c306591a None admin] RBAC: Adding query filter params (interface=public, service_id=545cd1289221421d8caf1a5f45ac5ea5, region_id=RegionOne) {{(pid=87173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:27:50.243953 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3056ad44-71be-49c3-b3eb-aae5c306591a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:50.245387 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3056ad44-71be-49c3-b3eb-aae5c306591a None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:50.250920 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 388/777] 10.222.0.62 () {56 vars in 1251 bytes} [Fri May 27 08:27:50 2022] GET /identity/v3/endpoints?service_id=545cd1289221421d8caf1a5f45ac5ea5&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:27:50.257050 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2fc4a5-616a-4899-a6ea-fd59f95ffa15 None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:50.286700 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:50.359400 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2fc4a5-616a-4899-a6ea-fd59f95ffa15 None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:50.394079 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf2afb9-8571-4d88-a6e0-8233d7c560cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:50.395150 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf2afb9-8571-4d88-a6e0-8233d7c560cb None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:50.396949 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf2afb9-8571-4d88-a6e0-8233d7c560cb None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:50.396949 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf2afb9-8571-4d88-a6e0-8233d7c560cb None admin] PATH_INFO: `/v3/services` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:50.396949 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf2afb9-8571-4d88-a6e0-8233d7c560cb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:50.397883 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf2afb9-8571-4d88-a6e0-8233d7c560cb None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:50.404516 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 390/778] 10.222.0.62 () {56 vars in 1087 bytes} [Fri May 27 08:27:50 2022] GET /identity/v3/services => generated 1498 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 08:27:52.337764 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d720a612-7497-4e0c-bb2d-4194dd123307 None None] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:52.338300 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d720a612-7497-4e0c-bb2d-4194dd123307 None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:52.338300 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d720a612-7497-4e0c-bb2d-4194dd123307 None None] PATH_INFO: `/` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:52.339688 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 389/779] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:27:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:27:52.345557 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fa2eed-1843-4c57-8427-0664ac5c3150 None None] REQUEST_METHOD: `POST` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:52.345998 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fa2eed-1843-4c57-8427-0664ac5c3150 None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:52.346124 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fa2eed-1843-4c57-8427-0664ac5c3150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:52.364332 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.auth.core [None req-07fa2eed-1843-4c57-8427-0664ac5c3150 None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:27:52.365567 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.fernet_utils [None req-07fa2eed-1843-4c57-8427-0664ac5c3150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:27:52.432720 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 391/780] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:27:52 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 08:27:52.457919 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d720a612-7497-4e0c-bb2d-4194dd123307 None None] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:52.572163 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d720a612-7497-4e0c-bb2d-4194dd123307 None None] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:52.610510 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229c31eb-eced-4b43-a53b-d6920a902f62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:52.611256 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229c31eb-eced-4b43-a53b-d6920a902f62 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:52.611539 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229c31eb-eced-4b43-a53b-d6920a902f62 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:52.611822 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229c31eb-eced-4b43-a53b-d6920a902f62 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:52.612481 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229c31eb-eced-4b43-a53b-d6920a902f62 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:52.613979 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229c31eb-eced-4b43-a53b-d6920a902f62 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:52.626973 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application [None req-229c31eb-eced-4b43-a53b-d6920a902f62 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 27 08:27:52.626973 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:27:52.626973 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 08:27:52.626973 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 08:27:52.626973 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 08:27:52.626973 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 08:27:52.626973 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 08:27:52.626973 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 08:27:52.626973 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 27 08:27:52.626973 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application May 27 08:27:52.626973 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 08:27:52.626973 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application May 27 08:27:52.626973 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:27:52.626973 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:27:52.626973 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:27:52.626973 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:27:52.627999 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:27:52.627999 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:27:52.627999 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:27:52.627999 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:27:52.627999 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:27:52.627999 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:27:52.627999 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:27:52.627999 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 08:27:52.627999 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 08:27:52.627999 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 08:27:52.627999 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 08:27:52.627999 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:27:52.627999 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:27:52.627999 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:27:52.627999 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:27:52.627999 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:27:52.628975 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:27:52.628975 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:27:52.628975 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application with Lock( May 27 08:27:52.628975 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:27:52.628975 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._enter() May 27 08:27:52.628975 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:27:52.628975 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:27:52.628975 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:27:52.628975 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.creator() May 27 08:27:52.628975 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:27:52.628975 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application created_value = creator( May 27 08:27:52.628975 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 08:27:52.628975 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 08:27:52.628975 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 27 08:27:52.628975 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application May 27 08:27:52.628975 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 390/781] 10.222.0.62 () {56 vars in 1132 bytes} [Fri May 27 08:27:52 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 08:27:52.635604 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fa2eed-1843-4c57-8427-0664ac5c3150 None None] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:52.657425 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:52.722671 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bcb213-48bf-44ac-b54e-f3724a718e0e None None] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:52.722951 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bcb213-48bf-44ac-b54e-f3724a718e0e None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:52.723238 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bcb213-48bf-44ac-b54e-f3724a718e0e None None] PATH_INFO: `/` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:52.724793 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 391/782] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:27:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 08:27:52.731054 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcd76a7-95dd-4674-b21f-3f19eabc7059 None None] REQUEST_METHOD: `POST` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:52.731346 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcd76a7-95dd-4674-b21f-3f19eabc7059 None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:52.731627 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcd76a7-95dd-4674-b21f-3f19eabc7059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:52.741777 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fa2eed-1843-4c57-8427-0664ac5c3150 None None] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:52.749061 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.auth.core [None req-cfcd76a7-95dd-4674-b21f-3f19eabc7059 None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:27:52.750296 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.fernet_utils [None req-cfcd76a7-95dd-4674-b21f-3f19eabc7059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:27:52.777629 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb89c46-c0a0-4e1e-b231-1723abbabd52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:52.778302 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb89c46-c0a0-4e1e-b231-1723abbabd52 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:52.778575 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb89c46-c0a0-4e1e-b231-1723abbabd52 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:52.778852 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb89c46-c0a0-4e1e-b231-1723abbabd52 None admin] PATH_INFO: `/v3/services` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:52.779566 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb89c46-c0a0-4e1e-b231-1723abbabd52 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:27:52.779867 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb89c46-c0a0-4e1e-b231-1723abbabd52 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:52.781830 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb89c46-c0a0-4e1e-b231-1723abbabd52 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:52.785924 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:52.787135 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 392/783] 10.222.0.62 () {56 vars in 1126 bytes} [Fri May 27 08:27:52 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:27:52.793162 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb89c46-c0a0-4e1e-b231-1723abbabd52 None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:52.821762 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 392/784] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:27:52 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 08:27:52.845902 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcd76a7-95dd-4674-b21f-3f19eabc7059 None None] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:52.882959 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:52.900051 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb89c46-c0a0-4e1e-b231-1723abbabd52 None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:52.935522 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e8815e-c8ea-4873-8993-6bef506c349a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:52.936191 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e8815e-c8ea-4873-8993-6bef506c349a None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:52.936480 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e8815e-c8ea-4873-8993-6bef506c349a None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:52.936837 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e8815e-c8ea-4873-8993-6bef506c349a None admin] PATH_INFO: `/v3/services` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:52.937562 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e8815e-c8ea-4873-8993-6bef506c349a None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:27:52.937867 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e8815e-c8ea-4873-8993-6bef506c349a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:52.939240 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e8815e-c8ea-4873-8993-6bef506c349a None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:52.944942 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 393/785] 10.222.0.62 () {56 vars in 1126 bytes} [Fri May 27 08:27:52 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 08:27:52.950588 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e8815e-c8ea-4873-8993-6bef506c349a None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:52.955456 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcd76a7-95dd-4674-b21f-3f19eabc7059 None None] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:52.989731 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75ffb75-24e8-46bd-a37f-087e1c884b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:52.990539 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75ffb75-24e8-46bd-a37f-087e1c884b92 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:52.990822 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75ffb75-24e8-46bd-a37f-087e1c884b92 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:52.991105 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75ffb75-24e8-46bd-a37f-087e1c884b92 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:52.991757 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75ffb75-24e8-46bd-a37f-087e1c884b92 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:52.993184 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75ffb75-24e8-46bd-a37f-087e1c884b92 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:53.005714 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application [None req-a75ffb75-24e8-46bd-a37f-087e1c884b92 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 27 08:27:53.005714 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:27:53.005714 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 08:27:53.005714 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 08:27:53.005714 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 08:27:53.005714 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 08:27:53.005714 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 08:27:53.005714 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 08:27:53.005714 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 27 08:27:53.005714 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application May 27 08:27:53.005714 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 08:27:53.005714 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application May 27 08:27:53.005714 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:27:53.005714 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:27:53.005714 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:27:53.005714 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:27:53.005714 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:27:53.006702 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:27:53.006702 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:27:53.006702 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:27:53.006702 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:27:53.006702 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:27:53.006702 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:27:53.006702 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 08:27:53.006702 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 08:27:53.006702 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 08:27:53.006702 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 08:27:53.006702 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:27:53.006702 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:27:53.006702 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:27:53.006702 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:27:53.006702 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:27:53.006702 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:27:53.007553 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:27:53.007553 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application with Lock( May 27 08:27:53.007553 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:27:53.007553 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._enter() May 27 08:27:53.007553 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:27:53.007553 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:27:53.007553 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:27:53.007553 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.creator() May 27 08:27:53.007553 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:27:53.007553 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application created_value = creator( May 27 08:27:53.007553 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 08:27:53.007553 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 08:27:53.007553 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 27 08:27:53.007553 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application May 27 08:27:53.007553 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 393/786] 10.222.0.62 () {56 vars in 1114 bytes} [Fri May 27 08:27:52 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 08:27:53.014112 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75ffb75-24e8-46bd-a37f-087e1c884b92 None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:53.048537 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:53.054036 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e8815e-c8ea-4873-8993-6bef506c349a None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:53.091093 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee66e855-0e2a-4345-8e56-f068614dfcbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:53.091755 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee66e855-0e2a-4345-8e56-f068614dfcbc None admin] REQUEST_METHOD: `POST` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:53.092040 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee66e855-0e2a-4345-8e56-f068614dfcbc None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:53.092320 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee66e855-0e2a-4345-8e56-f068614dfcbc None admin] PATH_INFO: `/v3/endpoints` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:53.093166 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee66e855-0e2a-4345-8e56-f068614dfcbc None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:53.094535 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee66e855-0e2a-4345-8e56-f068614dfcbc None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:53.114568 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 394/787] 10.222.0.62 () {60 vars in 1144 bytes} [Fri May 27 08:27:52 2022] POST /identity/v3/endpoints => generated 347 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 08:27:53.117152 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75ffb75-24e8-46bd-a37f-087e1c884b92 None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:53.161695 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56be6e2-471c-481a-969a-399bc9886810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:53.162283 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56be6e2-471c-481a-969a-399bc9886810 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:53.162568 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56be6e2-471c-481a-969a-399bc9886810 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:53.162848 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56be6e2-471c-481a-969a-399bc9886810 None admin] PATH_INFO: `/v3/services` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:53.163562 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56be6e2-471c-481a-969a-399bc9886810 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:27:53.163873 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56be6e2-471c-481a-969a-399bc9886810 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:53.165308 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56be6e2-471c-481a-969a-399bc9886810 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:53.170705 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 394/788] 10.222.0.62 () {56 vars in 1114 bytes} [Fri May 27 08:27:53 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 08:27:53.177657 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee66e855-0e2a-4345-8e56-f068614dfcbc None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:53.181840 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:53.287606 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee66e855-0e2a-4345-8e56-f068614dfcbc None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:53.323020 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42313a50-ed4a-48bd-b69b-d5d322b5fcb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:53.323684 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42313a50-ed4a-48bd-b69b-d5d322b5fcb9 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:53.323971 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42313a50-ed4a-48bd-b69b-d5d322b5fcb9 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:53.324247 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42313a50-ed4a-48bd-b69b-d5d322b5fcb9 None admin] PATH_INFO: `/v3/services` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:53.324996 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42313a50-ed4a-48bd-b69b-d5d322b5fcb9 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:27:53.325310 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42313a50-ed4a-48bd-b69b-d5d322b5fcb9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:53.326686 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42313a50-ed4a-48bd-b69b-d5d322b5fcb9 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:53.332242 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 395/789] 10.222.0.62 () {56 vars in 1114 bytes} [Fri May 27 08:27:53 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:27:53.337956 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56be6e2-471c-481a-969a-399bc9886810 None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:53.433637 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:53.441577 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56be6e2-471c-481a-969a-399bc9886810 None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:53.476133 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d99c8ae-fb49-4a50-8ea4-b82c892ab7d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:53.476827 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d99c8ae-fb49-4a50-8ea4-b82c892ab7d3 None admin] REQUEST_METHOD: `POST` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:53.477110 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d99c8ae-fb49-4a50-8ea4-b82c892ab7d3 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:53.477385 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d99c8ae-fb49-4a50-8ea4-b82c892ab7d3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:53.478129 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d99c8ae-fb49-4a50-8ea4-b82c892ab7d3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:53.479499 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d99c8ae-fb49-4a50-8ea4-b82c892ab7d3 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:53.502381 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 395/790] 10.222.0.62 () {60 vars in 1144 bytes} [Fri May 27 08:27:53 2022] POST /identity/v3/endpoints => generated 346 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 08:27:55.536048 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9e8724-523f-4661-89ce-855621a24e94 None None] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:55.536634 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9e8724-523f-4661-89ce-855621a24e94 None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:55.536634 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9e8724-523f-4661-89ce-855621a24e94 None None] PATH_INFO: `/` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:55.537989 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 396/791] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:27:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:27:55.543500 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc17d243-0765-4970-a019-56dfa7482acf None None] REQUEST_METHOD: `POST` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:55.543986 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc17d243-0765-4970-a019-56dfa7482acf None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:55.544089 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc17d243-0765-4970-a019-56dfa7482acf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:55.562396 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.auth.core [None req-bc17d243-0765-4970-a019-56dfa7482acf None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:27:55.563602 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.fernet_utils [None req-bc17d243-0765-4970-a019-56dfa7482acf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:27:55.637526 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 396/792] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:27:55 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 08:27:55.662273 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9e8724-523f-4661-89ce-855621a24e94 None None] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:55.730933 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:55.766358 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9e8724-523f-4661-89ce-855621a24e94 None None] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:55.801362 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e765c889-e919-4032-bde9-5a91e97eb3a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:55.802168 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e765c889-e919-4032-bde9-5a91e97eb3a2 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:55.802375 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e765c889-e919-4032-bde9-5a91e97eb3a2 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:55.802649 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e765c889-e919-4032-bde9-5a91e97eb3a2 None admin] PATH_INFO: `/v3/services/compute` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:55.803333 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e765c889-e919-4032-bde9-5a91e97eb3a2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:55.804839 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e765c889-e919-4032-bde9-5a91e97eb3a2 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:55.817959 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application [None req-e765c889-e919-4032-bde9-5a91e97eb3a2 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 27 08:27:55.817959 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:27:55.817959 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 08:27:55.817959 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 08:27:55.817959 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 08:27:55.817959 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 08:27:55.817959 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 08:27:55.817959 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 08:27:55.817959 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 27 08:27:55.817959 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application May 27 08:27:55.817959 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 08:27:55.817959 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application May 27 08:27:55.817959 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:27:55.817959 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:27:55.817959 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:27:55.817959 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:27:55.817959 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:27:55.819279 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:27:55.819279 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:27:55.819279 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:27:55.819279 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:27:55.819279 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:27:55.819279 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:27:55.819279 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 08:27:55.819279 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 08:27:55.819279 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 08:27:55.819279 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 08:27:55.819279 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:27:55.819279 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:27:55.819279 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:27:55.819279 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:27:55.819279 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:27:55.819279 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:27:55.820882 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:27:55.820882 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application with Lock( May 27 08:27:55.820882 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:27:55.820882 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._enter() May 27 08:27:55.820882 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:27:55.820882 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:27:55.820882 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:27:55.820882 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.creator() May 27 08:27:55.820882 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:27:55.820882 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application created_value = creator( May 27 08:27:55.820882 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 08:27:55.820882 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 08:27:55.820882 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 27 08:27:55.820882 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application May 27 08:27:55.825144 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 397/793] 10.222.0.62 () {56 vars in 1111 bytes} [Fri May 27 08:27:55 2022] GET /identity/v3/services/compute => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 08:27:55.829130 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc17d243-0765-4970-a019-56dfa7482acf None None] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:55.911130 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:55.936788 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc17d243-0765-4970-a019-56dfa7482acf None None] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:55.971189 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b35e49-d7a6-4486-b8bd-760e3831fcb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:55.971853 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b35e49-d7a6-4486-b8bd-760e3831fcb8 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:55.972139 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b35e49-d7a6-4486-b8bd-760e3831fcb8 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:55.972418 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b35e49-d7a6-4486-b8bd-760e3831fcb8 None admin] PATH_INFO: `/v3/services` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:55.973155 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b35e49-d7a6-4486-b8bd-760e3831fcb8 None admin] RBAC: Adding query filter params (name=compute) {{(pid=87173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:27:55.973465 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b35e49-d7a6-4486-b8bd-760e3831fcb8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:55.974866 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b35e49-d7a6-4486-b8bd-760e3831fcb8 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:55.979758 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 397/794] 10.222.0.62 () {56 vars in 1112 bytes} [Fri May 27 08:27:55 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:27:55.985573 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e765c889-e919-4032-bde9-5a91e97eb3a2 None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:56.012188 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5193c7-d7af-476e-af42-f231d0015bfb None None] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:56.012479 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5193c7-d7af-476e-af42-f231d0015bfb None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:56.012793 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5193c7-d7af-476e-af42-f231d0015bfb None None] PATH_INFO: `/` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:56.014347 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 398/795] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:27:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:27:56.020335 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a87cc0-baf3-4177-a8ee-b05394dfb141 None None] REQUEST_METHOD: `POST` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:56.020642 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a87cc0-baf3-4177-a8ee-b05394dfb141 None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:56.020928 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a87cc0-baf3-4177-a8ee-b05394dfb141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:56.038634 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.auth.core [None req-e4a87cc0-baf3-4177-a8ee-b05394dfb141 None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:27:56.039864 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.fernet_utils [None req-e4a87cc0-baf3-4177-a8ee-b05394dfb141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:27:56.107556 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e765c889-e919-4032-bde9-5a91e97eb3a2 None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:56.112719 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 399/796] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:27:56 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 27 08:27:56.144303 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a87cc0-baf3-4177-a8ee-b05394dfb141 None None] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:56.145898 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:56.151677 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6ecfbe-2bc2-4e27-95f6-b4b964ef52c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:56.152264 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6ecfbe-2bc2-4e27-95f6-b4b964ef52c5 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:56.152544 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6ecfbe-2bc2-4e27-95f6-b4b964ef52c5 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:56.152853 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6ecfbe-2bc2-4e27-95f6-b4b964ef52c5 None admin] PATH_INFO: `/v3/services` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:56.153572 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6ecfbe-2bc2-4e27-95f6-b4b964ef52c5 None admin] RBAC: Adding query filter params (type=compute) {{(pid=87172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:27:56.153879 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6ecfbe-2bc2-4e27-95f6-b4b964ef52c5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:56.155306 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6ecfbe-2bc2-4e27-95f6-b4b964ef52c5 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:56.159963 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 398/797] 10.222.0.62 () {56 vars in 1112 bytes} [Fri May 27 08:27:55 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:27:56.220719 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:56.256030 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a87cc0-baf3-4177-a8ee-b05394dfb141 None None] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:56.292708 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2438dc-0cf8-4abb-a27a-5610a6184e2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:56.293389 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2438dc-0cf8-4abb-a27a-5610a6184e2e None admin] REQUEST_METHOD: `POST` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:56.293677 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2438dc-0cf8-4abb-a27a-5610a6184e2e None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:56.294027 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2438dc-0cf8-4abb-a27a-5610a6184e2e None admin] PATH_INFO: `/v3/projects` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:56.294712 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2438dc-0cf8-4abb-a27a-5610a6184e2e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:56.296800 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2438dc-0cf8-4abb-a27a-5610a6184e2e None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:56.298227 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: WARNING keystone.server.flask.common [None req-ee2438dc-0cf8-4abb-a27a-5610a6184e2e None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 27 08:27:56.318407 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.sql.core [None req-ee2438dc-0cf8-4abb-a27a-5610a6184e2e None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 27 08:27:56.318407 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 27 08:27:56.318407 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [parameters: {'id': 'f6c41c4643dc402192f91cb5ee518083', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 27 08:27:56.318407 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=87173) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 27 08:27:56.335278 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application [None req-ee2438dc-0cf8-4abb-a27a-5610a6184e2e None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f6c41c4643dc402192f91cb5ee518083.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f6c41c4643dc402192f91cb5ee518083. May 27 08:27:56.335278 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:27:56.335278 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 27 08:27:56.335278 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application self.dialect.do_execute( May 27 08:27:56.335278 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 27 08:27:56.335278 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 27 08:27:56.335278 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 27 08:27:56.335278 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application result = self._query(query) May 27 08:27:56.335278 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 27 08:27:56.335278 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application conn.query(q) May 27 08:27:56.335278 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 27 08:27:56.335278 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 27 08:27:56.335278 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 27 08:27:56.336283 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application result.read() May 27 08:27:56.336283 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 27 08:27:56.336283 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 27 08:27:56.336283 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 27 08:27:56.336283 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application packet.raise_for_error() May 27 08:27:56.336283 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 27 08:27:56.336283 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 27 08:27:56.336283 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 27 08:27:56.336283 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 27 08:27:56.336283 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 27 08:27:56.336283 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application May 27 08:27:56.336283 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 27 08:27:56.336283 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application May 27 08:27:56.336283 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:27:56.336283 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 27 08:27:56.336283 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 27 08:27:56.336283 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 27 08:27:56.336283 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return project_ref.to_dict() May 27 08:27:56.337917 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 27 08:27:56.337917 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application next(self.gen) May 27 08:27:56.337917 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 27 08:27:56.337917 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application yield resource May 27 08:27:56.337917 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 27 08:27:56.337917 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application next(self.gen) May 27 08:27:56.337917 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 27 08:27:56.337917 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application self.session.rollback() May 27 08:27:56.337917 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 27 08:27:56.337917 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application self.force_reraise() May 27 08:27:56.337917 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 27 08:27:56.337917 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application raise self.value May 27 08:27:56.337917 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 27 08:27:56.337917 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 27 08:27:56.337917 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 27 08:27:56.337917 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application session.commit() May 27 08:27:56.337917 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 27 08:27:56.338819 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 27 08:27:56.338819 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 27 08:27:56.338819 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application self._prepare_impl() May 27 08:27:56.338819 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 27 08:27:56.338819 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application self.session.flush() May 27 08:27:56.338819 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 27 08:27:56.338819 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application self._flush(objects) May 27 08:27:56.338819 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 27 08:27:56.338819 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 27 08:27:56.338819 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 27 08:27:56.338819 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application compat.raise_( May 27 08:27:56.338819 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 27 08:27:56.338819 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application raise exception May 27 08:27:56.338819 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 27 08:27:56.338819 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application flush_context.execute() May 27 08:27:56.338819 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 27 08:27:56.338819 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application rec.execute(self) May 27 08:27:56.339753 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 27 08:27:56.339753 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 27 08:27:56.339753 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 27 08:27:56.339753 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application _emit_insert_statements( May 27 08:27:56.339753 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 27 08:27:56.339753 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application c = connection._execute_20( May 27 08:27:56.339753 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 27 08:27:56.339753 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 27 08:27:56.339753 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 27 08:27:56.339753 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 27 08:27:56.339753 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 27 08:27:56.339753 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application ret = self._execute_context( May 27 08:27:56.339753 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 27 08:27:56.339753 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 27 08:27:56.339753 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 27 08:27:56.340644 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 27 08:27:56.340644 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 27 08:27:56.340644 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application raise exception May 27 08:27:56.340644 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 27 08:27:56.340644 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application self.dialect.do_execute( May 27 08:27:56.340644 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 27 08:27:56.340644 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 27 08:27:56.340644 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 27 08:27:56.340644 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application result = self._query(query) May 27 08:27:56.340644 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 27 08:27:56.340644 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application conn.query(q) May 27 08:27:56.340644 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 27 08:27:56.340644 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 27 08:27:56.340644 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 27 08:27:56.340644 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application result.read() May 27 08:27:56.340644 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 27 08:27:56.340644 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 27 08:27:56.342322 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 27 08:27:56.342322 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application packet.raise_for_error() May 27 08:27:56.342322 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 27 08:27:56.342322 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 27 08:27:56.342322 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 27 08:27:56.342322 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 27 08:27:56.342322 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 27 08:27:56.342322 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 27 08:27:56.342322 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application [parameters: {'id': 'f6c41c4643dc402192f91cb5ee518083', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 27 08:27:56.342322 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 27 08:27:56.342322 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application May 27 08:27:56.342322 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 08:27:56.342322 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application May 27 08:27:56.342322 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:27:56.342322 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 27 08:27:56.343417 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 27 08:27:56.343417 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 27 08:27:56.343417 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 27 08:27:56.343417 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 27 08:27:56.343417 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application May 27 08:27:56.343417 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 08:27:56.343417 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application May 27 08:27:56.343417 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:27:56.343417 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:27:56.343417 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:27:56.343417 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:27:56.343417 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:27:56.343417 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:27:56.343417 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:27:56.343417 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:27:56.343417 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:27:56.343417 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:27:56.344546 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:27:56.344546 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 27 08:27:56.344546 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 27 08:27:56.344546 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:27:56.344546 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:27:56.344546 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 27 08:27:56.344546 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application raise exception.Conflict( May 27 08:27:56.344546 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f6c41c4643dc402192f91cb5ee518083. May 27 08:27:56.344546 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application May 27 08:27:56.344546 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 400/798] 10.222.0.62 () {60 vars in 1140 bytes} [Fri May 27 08:27:56 2022] POST /identity/v3/projects => generated 262 bytes in 193 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 27 08:27:56.345245 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6ecfbe-2bc2-4e27-95f6-b4b964ef52c5 None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:56.451007 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6ecfbe-2bc2-4e27-95f6-b4b964ef52c5 None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:56.490090 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f190d32-ede4-4f78-9bd6-e583f6e9d9f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:56.490883 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f190d32-ede4-4f78-9bd6-e583f6e9d9f4 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:56.491172 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f190d32-ede4-4f78-9bd6-e583f6e9d9f4 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:56.491452 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f190d32-ede4-4f78-9bd6-e583f6e9d9f4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:56.498195 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f190d32-ede4-4f78-9bd6-e583f6e9d9f4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:56.499712 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f190d32-ede4-4f78-9bd6-e583f6e9d9f4 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:56.514176 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application [None req-5f190d32-ede4-4f78-9bd6-e583f6e9d9f4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 08:27:56.514176 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:27:56.514176 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:27:56.514176 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:27:56.514176 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:27:56.514176 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:27:56.514176 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:27:56.514176 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:27:56.514176 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:27:56.514176 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:27:56.514176 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:27:56.514176 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:27:56.514176 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 08:27:56.514176 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 08:27:56.514176 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 08:27:56.520365 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 08:27:56.520365 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:27:56.520365 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:27:56.520365 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:27:56.520365 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:27:56.520365 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:27:56.520365 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:27:56.520365 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:27:56.520365 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application with Lock( May 27 08:27:56.520365 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:27:56.520365 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._enter() May 27 08:27:56.520365 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:27:56.520365 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:27:56.520365 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:27:56.520365 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.creator() May 27 08:27:56.520365 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:27:56.520365 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application created_value = creator( May 27 08:27:56.521596 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 08:27:56.521596 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 08:27:56.521596 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 08:27:56.521596 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 08:27:56.521596 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 08:27:56.521596 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 08:27:56.521596 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 08:27:56.521596 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application May 27 08:27:56.521596 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 399/799] 10.222.0.62 () {56 vars in 1111 bytes} [Fri May 27 08:27:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 08:27:56.522168 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2438dc-0cf8-4abb-a27a-5610a6184e2e None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:56.631240 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2438dc-0cf8-4abb-a27a-5610a6184e2e None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:56.662048 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:56.672570 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05fbcf3-d0f7-4c47-a826-107f2be92885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:56.673257 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05fbcf3-d0f7-4c47-a826-107f2be92885 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:56.673540 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05fbcf3-d0f7-4c47-a826-107f2be92885 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:56.673816 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05fbcf3-d0f7-4c47-a826-107f2be92885 None admin] PATH_INFO: `/v3/projects` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:56.674573 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05fbcf3-d0f7-4c47-a826-107f2be92885 None admin] RBAC: Adding query filter params (name=service) {{(pid=87173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:27:56.674880 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05fbcf3-d0f7-4c47-a826-107f2be92885 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:56.676534 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05fbcf3-d0f7-4c47-a826-107f2be92885 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:56.698063 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 401/800] 10.222.0.62 () {56 vars in 1112 bytes} [Fri May 27 08:27:56 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 08:27:58.503117 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43d9119-a847-48b1-b471-6fc8be46bd01 None None] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:58.503657 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43d9119-a847-48b1-b471-6fc8be46bd01 None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:58.503657 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43d9119-a847-48b1-b471-6fc8be46bd01 None None] PATH_INFO: `/` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:58.505081 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 400/801] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:27:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:27:58.510822 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da16b4d-f700-4d6c-91d0-6c28a37927bb None None] REQUEST_METHOD: `POST` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:58.511282 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da16b4d-f700-4d6c-91d0-6c28a37927bb None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:58.511502 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da16b4d-f700-4d6c-91d0-6c28a37927bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:58.529665 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.auth.core [None req-2da16b4d-f700-4d6c-91d0-6c28a37927bb None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:27:58.531727 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.fernet_utils [None req-2da16b4d-f700-4d6c-91d0-6c28a37927bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:27:58.611393 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 402/802] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:27:58 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 08:27:58.636300 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43d9119-a847-48b1-b471-6fc8be46bd01 None None] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:58.696643 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:58.744438 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43d9119-a847-48b1-b471-6fc8be46bd01 None None] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:58.779452 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d054b8-ee07-4503-b874-3833d8063c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:58.780548 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d054b8-ee07-4503-b874-3833d8063c13 None admin] REQUEST_METHOD: `POST` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:58.780861 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d054b8-ee07-4503-b874-3833d8063c13 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:58.781138 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d054b8-ee07-4503-b874-3833d8063c13 None admin] PATH_INFO: `/v3/services` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:58.781878 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d054b8-ee07-4503-b874-3833d8063c13 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:58.783250 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d054b8-ee07-4503-b874-3833d8063c13 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:58.797333 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 401/803] 10.222.0.62 () {60 vars in 1141 bytes} [Fri May 27 08:27:58 2022] POST /identity/v3/services => generated 242 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 08:27:59.051669 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f85292-3740-47e2-9ad4-65ccee0afa85 None None] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:59.051935 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f85292-3740-47e2-9ad4-65ccee0afa85 None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:59.052222 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f85292-3740-47e2-9ad4-65ccee0afa85 None None] PATH_INFO: `/` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:59.053649 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 403/804] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:27:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:27:59.059006 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1eb9fc-782b-4d64-8fc0-340368b0690b None None] REQUEST_METHOD: `POST` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:59.059301 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1eb9fc-782b-4d64-8fc0-340368b0690b None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:59.059584 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1eb9fc-782b-4d64-8fc0-340368b0690b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:59.078299 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.auth.core [None req-be1eb9fc-782b-4d64-8fc0-340368b0690b None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:27:59.079498 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.fernet_utils [None req-be1eb9fc-782b-4d64-8fc0-340368b0690b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:27:59.155345 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 402/805] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:27:59 2022] POST /identity/v3/auth/tokens => generated 1703 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 08:27:59.182701 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f85292-3740-47e2-9ad4-65ccee0afa85 None None] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:59.290359 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f85292-3740-47e2-9ad4-65ccee0afa85 None None] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:59.307379 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:59.326286 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec155d38-3c29-4947-86bf-dbdd16cc5d68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:59.327128 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec155d38-3c29-4947-86bf-dbdd16cc5d68 None admin] REQUEST_METHOD: `POST` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:59.327541 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec155d38-3c29-4947-86bf-dbdd16cc5d68 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:59.327957 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec155d38-3c29-4947-86bf-dbdd16cc5d68 None admin] PATH_INFO: `/v3/users` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:59.328533 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec155d38-3c29-4947-86bf-dbdd16cc5d68 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:59.330025 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec155d38-3c29-4947-86bf-dbdd16cc5d68 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:59.344003 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.sql.core [None req-ec155d38-3c29-4947-86bf-dbdd16cc5d68 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 27 08:27:59.344003 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 27 08:27:59.344003 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [parameters: {'user_id': '17f0aeb0dd2d45ce850d64476f36577b', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 27 08:27:59.344003 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=87173) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 27 08:27:59.351358 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application [None req-ec155d38-3c29-4947-86bf-dbdd16cc5d68 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 27 08:27:59.351358 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:27:59.351358 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 27 08:27:59.351358 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application self.dialect.do_execute( May 27 08:27:59.351358 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 27 08:27:59.351358 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 27 08:27:59.351358 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 27 08:27:59.351358 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application result = self._query(query) May 27 08:27:59.351358 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 27 08:27:59.351358 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application conn.query(q) May 27 08:27:59.351358 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 27 08:27:59.351358 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 27 08:27:59.351358 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 27 08:27:59.351358 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application result.read() May 27 08:27:59.351358 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 27 08:27:59.357997 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 27 08:27:59.357997 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 27 08:27:59.357997 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application packet.raise_for_error() May 27 08:27:59.357997 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 27 08:27:59.357997 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 27 08:27:59.357997 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 27 08:27:59.357997 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 27 08:27:59.357997 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 27 08:27:59.357997 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application May 27 08:27:59.357997 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 27 08:27:59.357997 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application May 27 08:27:59.357997 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:27:59.357997 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 27 08:27:59.357997 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 27 08:27:59.357997 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 27 08:27:59.357997 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 27 08:27:59.357997 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 27 08:27:59.357997 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application next(self.gen) May 27 08:27:59.359553 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 27 08:27:59.359553 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application yield resource May 27 08:27:59.359553 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 27 08:27:59.359553 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application next(self.gen) May 27 08:27:59.359553 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 27 08:27:59.359553 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application self.session.rollback() May 27 08:27:59.359553 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 27 08:27:59.359553 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application self.force_reraise() May 27 08:27:59.359553 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 27 08:27:59.359553 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application raise self.value May 27 08:27:59.359553 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 27 08:27:59.359553 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 27 08:27:59.359553 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 27 08:27:59.359553 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application session.commit() May 27 08:27:59.359553 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 27 08:27:59.359553 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 27 08:27:59.359553 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 27 08:27:59.360431 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application self._prepare_impl() May 27 08:27:59.360431 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 27 08:27:59.360431 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application self.session.flush() May 27 08:27:59.360431 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 27 08:27:59.360431 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application self._flush(objects) May 27 08:27:59.360431 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 27 08:27:59.360431 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 27 08:27:59.360431 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 27 08:27:59.360431 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application compat.raise_( May 27 08:27:59.360431 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 27 08:27:59.360431 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application raise exception May 27 08:27:59.360431 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 27 08:27:59.360431 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application flush_context.execute() May 27 08:27:59.360431 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 27 08:27:59.360431 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application rec.execute(self) May 27 08:27:59.360431 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 27 08:27:59.360431 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 27 08:27:59.361333 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 27 08:27:59.361333 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application _emit_insert_statements( May 27 08:27:59.361333 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 27 08:27:59.361333 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application result = connection._execute_20( May 27 08:27:59.361333 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 27 08:27:59.361333 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 27 08:27:59.361333 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 27 08:27:59.361333 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 27 08:27:59.361333 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 27 08:27:59.361333 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application ret = self._execute_context( May 27 08:27:59.361333 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 27 08:27:59.361333 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 27 08:27:59.361333 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 27 08:27:59.361333 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 27 08:27:59.361333 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 27 08:27:59.361333 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application raise exception May 27 08:27:59.362162 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 27 08:27:59.362162 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application self.dialect.do_execute( May 27 08:27:59.362162 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 27 08:27:59.362162 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 27 08:27:59.362162 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 27 08:27:59.362162 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application result = self._query(query) May 27 08:27:59.362162 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 27 08:27:59.362162 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application conn.query(q) May 27 08:27:59.362162 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 27 08:27:59.362162 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 27 08:27:59.362162 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 27 08:27:59.362162 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application result.read() May 27 08:27:59.362162 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 27 08:27:59.362162 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 27 08:27:59.362162 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 27 08:27:59.362162 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application packet.raise_for_error() May 27 08:27:59.363001 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 27 08:27:59.363001 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 27 08:27:59.363001 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 27 08:27:59.363001 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 27 08:27:59.363001 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 27 08:27:59.363001 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 27 08:27:59.363001 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application [parameters: {'user_id': '17f0aeb0dd2d45ce850d64476f36577b', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 27 08:27:59.363001 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 27 08:27:59.363001 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application May 27 08:27:59.363001 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 08:27:59.363001 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application May 27 08:27:59.363001 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:27:59.363001 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:27:59.363001 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:27:59.363001 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:27:59.364811 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:27:59.364811 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:27:59.364811 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:27:59.364811 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:27:59.364811 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:27:59.364811 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:27:59.364811 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:27:59.364811 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 27 08:27:59.364811 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 27 08:27:59.364811 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:27:59.364811 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:27:59.364811 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 08:27:59.364811 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 08:27:59.364811 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 08:27:59.364811 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 08:27:59.364811 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 27 08:27:59.364811 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 27 08:27:59.365964 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 27 08:27:59.365964 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 27 08:27:59.365964 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 27 08:27:59.365964 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 27 08:27:59.365964 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 27 08:27:59.365964 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application May 27 08:27:59.365964 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 404/806] 10.222.0.62 () {60 vars in 1131 bytes} [Fri May 27 08:27:59 2022] POST /identity/v3/users => generated 160 bytes in 171 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 27 08:27:59.366419 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1eb9fc-782b-4d64-8fc0-340368b0690b None None] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:59.405527 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:27:59.469566 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1eb9fc-782b-4d64-8fc0-340368b0690b None None] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:59.503681 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaa8a4b-9568-4319-bb76-3844b9d0afc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:59.504474 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaa8a4b-9568-4319-bb76-3844b9d0afc8 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:59.504793 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaa8a4b-9568-4319-bb76-3844b9d0afc8 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:59.505073 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaa8a4b-9568-4319-bb76-3844b9d0afc8 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:59.512163 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaa8a4b-9568-4319-bb76-3844b9d0afc8 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:59.513633 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaa8a4b-9568-4319-bb76-3844b9d0afc8 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:59.528898 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application [None req-afaa8a4b-9568-4319-bb76-3844b9d0afc8 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 27 08:27:59.528898 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:27:59.528898 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:27:59.528898 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:27:59.528898 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:27:59.528898 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:27:59.528898 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:27:59.528898 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:27:59.528898 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:27:59.528898 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:27:59.528898 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:27:59.528898 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:27:59.528898 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 08:27:59.528898 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 08:27:59.528898 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 08:27:59.528898 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 08:27:59.531281 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:27:59.531281 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:27:59.531281 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 08:27:59.531281 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 08:27:59.531281 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 08:27:59.531281 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 08:27:59.531281 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:27:59.531281 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:27:59.531281 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:27:59.531281 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:27:59.531281 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:27:59.531281 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application with Lock( May 27 08:27:59.531281 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:27:59.531281 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._enter() May 27 08:27:59.531281 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:27:59.531281 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:27:59.531281 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:27:59.531281 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.creator() May 27 08:27:59.533290 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:27:59.533290 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application created_value = creator( May 27 08:27:59.533290 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 08:27:59.533290 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 08:27:59.533290 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 08:27:59.533290 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 08:27:59.533290 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 08:27:59.533290 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 08:27:59.533290 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 27 08:27:59.533290 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application May 27 08:27:59.533290 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 403/807] 10.222.0.62 () {56 vars in 1099 bytes} [Fri May 27 08:27:59 2022] GET /identity/v3/users/cinder => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 08:27:59.538621 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec155d38-3c29-4947-86bf-dbdd16cc5d68 None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:27:59.657517 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec155d38-3c29-4947-86bf-dbdd16cc5d68 None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:27:59.693249 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aecdcda-18e1-42c8-99b3-db86c2dc976a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:27:59.693920 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aecdcda-18e1-42c8-99b3-db86c2dc976a None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:27:59.694202 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aecdcda-18e1-42c8-99b3-db86c2dc976a None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:27:59.694483 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aecdcda-18e1-42c8-99b3-db86c2dc976a None admin] PATH_INFO: `/v3/users` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:27:59.695290 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aecdcda-18e1-42c8-99b3-db86c2dc976a None admin] RBAC: Adding query filter params (name=cinder) {{(pid=87173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:27:59.695596 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aecdcda-18e1-42c8-99b3-db86c2dc976a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:27:59.697317 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aecdcda-18e1-42c8-99b3-db86c2dc976a None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:27:59.736838 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 405/808] 10.222.0.62 () {56 vars in 1101 bytes} [Fri May 27 08:27:59 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:28:01.180571 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f464483-bf8c-4da4-a2ba-4ccea8e0bf93 None None] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:28:01.181171 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f464483-bf8c-4da4-a2ba-4ccea8e0bf93 None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:28:01.181171 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f464483-bf8c-4da4-a2ba-4ccea8e0bf93 None None] PATH_INFO: `/` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:28:01.182505 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 404/809] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:28:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:28:01.188274 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88fbe54-681b-4a27-8172-11e6d1a35581 None None] REQUEST_METHOD: `POST` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:28:01.188775 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88fbe54-681b-4a27-8172-11e6d1a35581 None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:28:01.188885 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88fbe54-681b-4a27-8172-11e6d1a35581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:28:01.206016 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.auth.core [None req-c88fbe54-681b-4a27-8172-11e6d1a35581 None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:28:01.207544 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.fernet_utils [None req-c88fbe54-681b-4a27-8172-11e6d1a35581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:28:01.237701 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:28:01.279337 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 406/810] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:28:01 2022] POST /identity/v3/auth/tokens => generated 1703 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 08:28:01.305275 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f464483-bf8c-4da4-a2ba-4ccea8e0bf93 None None] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:28:01.422001 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f464483-bf8c-4da4-a2ba-4ccea8e0bf93 None None] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:28:01.423515 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:28:01.457361 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5147507-9e50-419f-9171-ff318ea9c2e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:28:01.458063 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5147507-9e50-419f-9171-ff318ea9c2e5 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:28:01.458349 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5147507-9e50-419f-9171-ff318ea9c2e5 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:28:01.458623 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5147507-9e50-419f-9171-ff318ea9c2e5 None admin] PATH_INFO: `/v3/services/compute` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:28:01.459266 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5147507-9e50-419f-9171-ff318ea9c2e5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:28:01.460652 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5147507-9e50-419f-9171-ff318ea9c2e5 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:28:01.472918 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application [None req-f5147507-9e50-419f-9171-ff318ea9c2e5 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 27 08:28:01.472918 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:28:01.472918 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 08:28:01.472918 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 08:28:01.472918 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 08:28:01.472918 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 08:28:01.472918 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 08:28:01.472918 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 08:28:01.472918 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 27 08:28:01.472918 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application May 27 08:28:01.472918 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 08:28:01.472918 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application May 27 08:28:01.472918 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:28:01.472918 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:28:01.472918 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:28:01.472918 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:28:01.472918 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:28:01.474066 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:28:01.474066 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:28:01.474066 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:28:01.474066 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:28:01.474066 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:28:01.474066 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:28:01.474066 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 08:28:01.474066 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 08:28:01.474066 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 08:28:01.474066 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 08:28:01.474066 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:28:01.474066 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:28:01.474066 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:28:01.474066 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:28:01.474066 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:28:01.474066 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:28:01.475258 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:28:01.475258 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application with Lock( May 27 08:28:01.475258 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:28:01.475258 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._enter() May 27 08:28:01.475258 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:28:01.475258 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:28:01.475258 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:28:01.475258 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.creator() May 27 08:28:01.475258 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:28:01.475258 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application created_value = creator( May 27 08:28:01.475258 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 08:28:01.475258 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 08:28:01.475258 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 27 08:28:01.475258 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application May 27 08:28:01.475258 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 405/811] 10.222.0.62 () {56 vars in 1111 bytes} [Fri May 27 08:28:01 2022] GET /identity/v3/services/compute => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 08:28:01.481531 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88fbe54-681b-4a27-8172-11e6d1a35581 None None] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:28:01.579311 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88fbe54-681b-4a27-8172-11e6d1a35581 None None] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:28:01.613209 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4526b6-5fca-48da-990b-de4dcf871574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:28:01.613866 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4526b6-5fca-48da-990b-de4dcf871574 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:28:01.614155 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4526b6-5fca-48da-990b-de4dcf871574 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:28:01.614431 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4526b6-5fca-48da-990b-de4dcf871574 None admin] PATH_INFO: `/v3/services` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:28:01.615133 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4526b6-5fca-48da-990b-de4dcf871574 None admin] RBAC: Adding query filter params (name=compute) {{(pid=87173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:28:01.615437 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4526b6-5fca-48da-990b-de4dcf871574 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:28:01.616857 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4526b6-5fca-48da-990b-de4dcf871574 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:28:01.621658 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 407/812] 10.222.0.62 () {56 vars in 1112 bytes} [Fri May 27 08:28:01 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:28:01.627487 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5147507-9e50-419f-9171-ff318ea9c2e5 None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:28:01.728370 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5147507-9e50-419f-9171-ff318ea9c2e5 None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:28:01.761287 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403de7e4-874a-4b0c-8d15-cf56829b922b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:28:01.761939 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403de7e4-874a-4b0c-8d15-cf56829b922b None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:28:01.762223 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403de7e4-874a-4b0c-8d15-cf56829b922b None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:28:01.762499 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403de7e4-874a-4b0c-8d15-cf56829b922b None admin] PATH_INFO: `/v3/services` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:28:01.763202 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403de7e4-874a-4b0c-8d15-cf56829b922b None admin] RBAC: Adding query filter params (type=compute) {{(pid=87172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:28:01.763509 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403de7e4-874a-4b0c-8d15-cf56829b922b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:28:01.765483 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403de7e4-874a-4b0c-8d15-cf56829b922b None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:28:01.770203 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 406/813] 10.222.0.62 () {56 vars in 1112 bytes} [Fri May 27 08:28:01 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:28:01.776275 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4526b6-5fca-48da-990b-de4dcf871574 None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:28:01.807036 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:28:01.878298 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4526b6-5fca-48da-990b-de4dcf871574 None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:28:01.911713 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50423762-d00f-425f-8e48-4e780072c2bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:28:01.912356 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50423762-d00f-425f-8e48-4e780072c2bc None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:28:01.912664 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50423762-d00f-425f-8e48-4e780072c2bc None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:28:01.912942 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50423762-d00f-425f-8e48-4e780072c2bc None admin] PATH_INFO: `/v3/endpoints` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:28:01.913718 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50423762-d00f-425f-8e48-4e780072c2bc None admin] RBAC: Adding query filter params (interface=public, service_id=44be30e86b43494e8b8f3d90d6d6c221, region_id=RegionOne) {{(pid=87173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:28:01.914022 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50423762-d00f-425f-8e48-4e780072c2bc None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:28:01.915416 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50423762-d00f-425f-8e48-4e780072c2bc None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:28:01.920263 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 408/814] 10.222.0.62 () {56 vars in 1251 bytes} [Fri May 27 08:28:01 2022] GET /identity/v3/endpoints?service_id=44be30e86b43494e8b8f3d90d6d6c221&interface=public®ion_id=RegionOne => generated 194 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:28:01.926300 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403de7e4-874a-4b0c-8d15-cf56829b922b None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:28:01.957637 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:28:02.028072 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403de7e4-874a-4b0c-8d15-cf56829b922b None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:28:02.060601 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6ffd09-f93a-490e-852f-e79cf0f9bc45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:28:02.061952 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6ffd09-f93a-490e-852f-e79cf0f9bc45 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:28:02.062234 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6ffd09-f93a-490e-852f-e79cf0f9bc45 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:28:02.062512 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6ffd09-f93a-490e-852f-e79cf0f9bc45 None admin] PATH_INFO: `/v3/services` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:28:02.063196 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6ffd09-f93a-490e-852f-e79cf0f9bc45 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:28:02.064579 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6ffd09-f93a-490e-852f-e79cf0f9bc45 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:28:02.070714 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 407/815] 10.222.0.62 () {56 vars in 1087 bytes} [Fri May 27 08:28:01 2022] GET /identity/v3/services => generated 1728 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 08:28:04.378456 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a8c961-76d5-497b-a227-a7a9c7fc816d None None] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:28:04.378993 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a8c961-76d5-497b-a227-a7a9c7fc816d None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:28:04.378993 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a8c961-76d5-497b-a227-a7a9c7fc816d None None] PATH_INFO: `/` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:28:04.380387 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 409/816] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:28:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:28:04.386023 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a7cf53-027c-419d-b4e9-cccdc447db2e None None] REQUEST_METHOD: `POST` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:28:04.386480 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a7cf53-027c-419d-b4e9-cccdc447db2e None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:28:04.386573 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a7cf53-027c-419d-b4e9-cccdc447db2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:28:04.403788 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.auth.core [None req-f3a7cf53-027c-419d-b4e9-cccdc447db2e None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:28:04.405053 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.fernet_utils [None req-f3a7cf53-027c-419d-b4e9-cccdc447db2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:28:04.477217 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 408/817] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:28:04 2022] POST /identity/v3/auth/tokens => generated 1703 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 08:28:04.502363 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a8c961-76d5-497b-a227-a7a9c7fc816d None None] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:28:04.603045 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:28:04.612352 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a8c961-76d5-497b-a227-a7a9c7fc816d None None] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:28:04.650233 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb38f6b-46be-41d6-867e-ee4c6ae75f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:28:04.651150 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb38f6b-46be-41d6-867e-ee4c6ae75f9e None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:28:04.651388 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb38f6b-46be-41d6-867e-ee4c6ae75f9e None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:28:04.651642 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb38f6b-46be-41d6-867e-ee4c6ae75f9e None admin] PATH_INFO: `/v3/services/compute` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:28:04.652250 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb38f6b-46be-41d6-867e-ee4c6ae75f9e None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:28:04.653699 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb38f6b-46be-41d6-867e-ee4c6ae75f9e None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:28:04.666473 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application [None req-3eb38f6b-46be-41d6-867e-ee4c6ae75f9e None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 27 08:28:04.666473 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:28:04.666473 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 08:28:04.666473 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 08:28:04.666473 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 08:28:04.666473 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 08:28:04.666473 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 08:28:04.666473 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 08:28:04.666473 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 27 08:28:04.666473 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application May 27 08:28:04.666473 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 08:28:04.666473 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application May 27 08:28:04.666473 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:28:04.666473 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:28:04.666473 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:28:04.666473 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:28:04.666473 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:28:04.667759 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:28:04.667759 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:28:04.667759 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:28:04.667759 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:28:04.667759 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:28:04.667759 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:28:04.667759 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 08:28:04.667759 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 08:28:04.667759 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 08:28:04.667759 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 08:28:04.667759 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:28:04.667759 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:28:04.667759 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:28:04.667759 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:28:04.667759 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:28:04.667759 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:28:04.668646 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:28:04.668646 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application with Lock( May 27 08:28:04.668646 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:28:04.668646 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._enter() May 27 08:28:04.668646 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:28:04.668646 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:28:04.668646 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:28:04.668646 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.creator() May 27 08:28:04.668646 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:28:04.668646 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application created_value = creator( May 27 08:28:04.668646 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 08:28:04.668646 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 08:28:04.668646 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 27 08:28:04.668646 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application May 27 08:28:04.668646 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 410/818] 10.222.0.62 () {56 vars in 1111 bytes} [Fri May 27 08:28:04 2022] GET /identity/v3/services/compute => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 08:28:04.675755 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a7cf53-027c-419d-b4e9-cccdc447db2e None None] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:28:04.701432 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:28:04.782494 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a7cf53-027c-419d-b4e9-cccdc447db2e None None] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:28:04.818964 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307811dd-315a-4e64-864b-04a10dfc363c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:28:04.819626 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307811dd-315a-4e64-864b-04a10dfc363c None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:28:04.819909 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307811dd-315a-4e64-864b-04a10dfc363c None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:28:04.820186 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307811dd-315a-4e64-864b-04a10dfc363c None admin] PATH_INFO: `/v3/services` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:28:04.820930 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307811dd-315a-4e64-864b-04a10dfc363c None admin] RBAC: Adding query filter params (name=compute) {{(pid=87172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:28:04.821237 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307811dd-315a-4e64-864b-04a10dfc363c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:28:04.822627 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307811dd-315a-4e64-864b-04a10dfc363c None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:28:04.828199 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 409/819] 10.222.0.62 () {56 vars in 1112 bytes} [Fri May 27 08:28:04 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:28:04.834707 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb38f6b-46be-41d6-867e-ee4c6ae75f9e None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:28:04.943038 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb38f6b-46be-41d6-867e-ee4c6ae75f9e None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:28:04.977951 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d1aef4-796b-4ff5-bbc5-c2097e6c41ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:28:04.978632 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d1aef4-796b-4ff5-bbc5-c2097e6c41ad None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:28:04.978915 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d1aef4-796b-4ff5-bbc5-c2097e6c41ad None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:28:04.979197 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d1aef4-796b-4ff5-bbc5-c2097e6c41ad None admin] PATH_INFO: `/v3/services` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:28:04.979918 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d1aef4-796b-4ff5-bbc5-c2097e6c41ad None admin] RBAC: Adding query filter params (type=compute) {{(pid=87173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:28:04.980226 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d1aef4-796b-4ff5-bbc5-c2097e6c41ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:28:04.981671 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d1aef4-796b-4ff5-bbc5-c2097e6c41ad None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:28:04.987962 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 411/820] 10.222.0.62 () {56 vars in 1112 bytes} [Fri May 27 08:28:04 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:28:04.994045 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307811dd-315a-4e64-864b-04a10dfc363c None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:28:05.085713 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:28:05.098946 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307811dd-315a-4e64-864b-04a10dfc363c None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:28:05.132806 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc242d69-7883-4d20-a874-225033e1e72f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:28:05.133470 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc242d69-7883-4d20-a874-225033e1e72f None admin] REQUEST_METHOD: `POST` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:28:05.133763 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc242d69-7883-4d20-a874-225033e1e72f None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:28:05.134043 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc242d69-7883-4d20-a874-225033e1e72f None admin] PATH_INFO: `/v3/endpoints` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:28:05.134796 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc242d69-7883-4d20-a874-225033e1e72f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:28:05.136211 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc242d69-7883-4d20-a874-225033e1e72f None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:28:05.155328 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 410/821] 10.222.0.62 () {60 vars in 1144 bytes} [Fri May 27 08:28:04 2022] POST /identity/v3/endpoints => generated 334 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 08:28:14.986413 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=89 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:28:15.150309 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=27,keystone:INSERT=1 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:29:08.943251 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c8752d-f1c8-4819-95ae-1fb92df18e63 None None] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:29:08.943804 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c8752d-f1c8-4819-95ae-1fb92df18e63 None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:29:08.943899 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c8752d-f1c8-4819-95ae-1fb92df18e63 None None] PATH_INFO: `/` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:29:08.945610 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 412/822] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:29:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:29:08.954282 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088b9a94-6e4b-498e-b7d0-117e1d84797f None None] REQUEST_METHOD: `POST` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:29:08.954282 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088b9a94-6e4b-498e-b7d0-117e1d84797f None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:29:08.954282 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088b9a94-6e4b-498e-b7d0-117e1d84797f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:29:08.973233 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.auth.core [None req-088b9a94-6e4b-498e-b7d0-117e1d84797f None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:29:08.974531 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.fernet_utils [None req-088b9a94-6e4b-498e-b7d0-117e1d84797f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:29:09.080673 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 411/823] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:29:08 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 08:29:09.109256 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c8752d-f1c8-4819-95ae-1fb92df18e63 None None] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:29:09.243374 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c8752d-f1c8-4819-95ae-1fb92df18e63 None None] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:29:09.296537 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8708426-5d6b-4b61-8d0e-0a67822209aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:29:09.297914 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8708426-5d6b-4b61-8d0e-0a67822209aa None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:29:09.298403 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8708426-5d6b-4b61-8d0e-0a67822209aa None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:29:09.298884 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8708426-5d6b-4b61-8d0e-0a67822209aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:29:09.313706 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8708426-5d6b-4b61-8d0e-0a67822209aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:29:09.316219 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8708426-5d6b-4b61-8d0e-0a67822209aa None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:29:09.341543 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application [None req-b8708426-5d6b-4b61-8d0e-0a67822209aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 08:29:09.341543 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:29:09.341543 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:29:09.341543 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:29:09.341543 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:29:09.341543 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:29:09.341543 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:29:09.341543 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:29:09.341543 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:29:09.341543 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:29:09.341543 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:29:09.341543 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:29:09.341543 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 08:29:09.341543 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 08:29:09.341543 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 08:29:09.342644 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 08:29:09.342644 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:29:09.342644 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:29:09.342644 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:29:09.342644 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:29:09.342644 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:29:09.342644 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:29:09.342644 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:29:09.342644 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application with Lock( May 27 08:29:09.342644 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:29:09.342644 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._enter() May 27 08:29:09.342644 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:29:09.342644 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:29:09.342644 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:29:09.342644 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.creator() May 27 08:29:09.342644 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:29:09.342644 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application created_value = creator( May 27 08:29:09.343985 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 08:29:09.343985 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 08:29:09.343985 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 08:29:09.343985 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application May 27 08:29:09.348946 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 413/824] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 08:29:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 08:29:09.350080 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088b9a94-6e4b-498e-b7d0-117e1d84797f None None] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:29:09.485356 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088b9a94-6e4b-498e-b7d0-117e1d84797f None None] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:29:09.519957 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:29:09.531281 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914bbccf-9c03-4910-8603-d811387d90b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:29:09.531941 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914bbccf-9c03-4910-8603-d811387d90b5 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:29:09.532267 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914bbccf-9c03-4910-8603-d811387d90b5 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:29:09.532548 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914bbccf-9c03-4910-8603-d811387d90b5 None admin] PATH_INFO: `/v3/domains` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:29:09.533403 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914bbccf-9c03-4910-8603-d811387d90b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:29:09.533976 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914bbccf-9c03-4910-8603-d811387d90b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:29:09.535459 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914bbccf-9c03-4910-8603-d811387d90b5 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:29:09.553820 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 412/825] 10.222.0.62 () {56 vars in 1109 bytes} [Fri May 27 08:29:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:29:09.555033 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8708426-5d6b-4b61-8d0e-0a67822209aa None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:29:09.628899 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:29:09.714586 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8708426-5d6b-4b61-8d0e-0a67822209aa None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:29:09.762292 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bd7352-033d-4757-9bb4-a662b57d3f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:29:09.763008 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bd7352-033d-4757-9bb4-a662b57d3f80 None admin] REQUEST_METHOD: `POST` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:29:09.763368 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bd7352-033d-4757-9bb4-a662b57d3f80 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:29:09.763646 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bd7352-033d-4757-9bb4-a662b57d3f80 None admin] PATH_INFO: `/v3/users` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:29:09.764362 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bd7352-033d-4757-9bb4-a662b57d3f80 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:29:09.765859 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bd7352-033d-4757-9bb4-a662b57d3f80 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:29:09.788932 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 414/826] 10.222.0.62 () {60 vars in 1132 bytes} [Fri May 27 08:29:09 2022] POST /identity/v3/users => generated 251 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 08:29:12.256352 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929764c9-09c3-470c-9567-106ff8eff351 None None] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:29:12.256965 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929764c9-09c3-470c-9567-106ff8eff351 None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:29:12.257486 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929764c9-09c3-470c-9567-106ff8eff351 None None] PATH_INFO: `/` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:29:12.258670 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 413/827] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:29:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 08:29:12.264664 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a74ad5-c480-4501-97db-a2e9ba941a19 None None] REQUEST_METHOD: `POST` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:29:12.265144 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a74ad5-c480-4501-97db-a2e9ba941a19 None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:29:12.265245 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a74ad5-c480-4501-97db-a2e9ba941a19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:29:12.285347 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.auth.core [None req-29a74ad5-c480-4501-97db-a2e9ba941a19 None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:29:12.286553 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.fernet_utils [None req-29a74ad5-c480-4501-97db-a2e9ba941a19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:29:12.366025 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 415/828] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:29:12 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 08:29:12.393198 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929764c9-09c3-470c-9567-106ff8eff351 None None] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:29:12.520430 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929764c9-09c3-470c-9567-106ff8eff351 None None] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:29:12.562052 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863decdc-72d1-4b48-aa8b-8894921e78d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:29:12.562852 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863decdc-72d1-4b48-aa8b-8894921e78d0 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:29:12.563138 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863decdc-72d1-4b48-aa8b-8894921e78d0 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:29:12.563414 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863decdc-72d1-4b48-aa8b-8894921e78d0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:29:12.576740 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863decdc-72d1-4b48-aa8b-8894921e78d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 08:29:12.586237 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application [None req-863decdc-72d1-4b48-aa8b-8894921e78d0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 08:29:12.586237 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:29:12.586237 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:29:12.586237 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:29:12.586237 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:29:12.586237 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:29:12.586237 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:29:12.586237 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:29:12.586237 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:29:12.586237 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:29:12.586237 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:29:12.586237 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:29:12.586237 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 08:29:12.586237 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 08:29:12.586237 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 08:29:12.586237 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 08:29:12.587347 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 08:29:12.587347 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 08:29:12.587347 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 08:29:12.587347 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 08:29:12.587347 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:29:12.587347 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:29:12.587347 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:29:12.587347 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:29:12.587347 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:29:12.587347 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:29:12.587347 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:29:12.587347 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application with Lock( May 27 08:29:12.587347 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:29:12.587347 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._enter() May 27 08:29:12.587347 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:29:12.587347 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:29:12.588906 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:29:12.588906 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.creator() May 27 08:29:12.588906 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:29:12.588906 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application created_value = creator( May 27 08:29:12.588906 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 08:29:12.588906 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 08:29:12.588906 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 08:29:12.588906 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 08:29:12.588906 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 08:29:12.588906 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 08:29:12.588906 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 08:29:12.588906 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application May 27 08:29:12.588906 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 414/829] 10.222.0.62 () {56 vars in 1102 bytes} [Fri May 27 08:29:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 08:29:12.594511 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a74ad5-c480-4501-97db-a2e9ba941a19 None None] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:29:12.641780 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:29:12.712414 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a74ad5-c480-4501-97db-a2e9ba941a19 None None] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:29:12.751153 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceae1d2-f7ba-48fb-a506-b2f9ee6e336f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:29:12.751894 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceae1d2-f7ba-48fb-a506-b2f9ee6e336f None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:29:12.752184 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceae1d2-f7ba-48fb-a506-b2f9ee6e336f None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:29:12.752495 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceae1d2-f7ba-48fb-a506-b2f9ee6e336f None admin] PATH_INFO: `/v3/roles` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:29:12.753285 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ceae1d2-f7ba-48fb-a506-b2f9ee6e336f None admin] RBAC: Adding query filter params (name=service) {{(pid=87173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:29:12.753594 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ceae1d2-f7ba-48fb-a506-b2f9ee6e336f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:29:12.755058 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ceae1d2-f7ba-48fb-a506-b2f9ee6e336f None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:29:12.763841 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 416/830] 10.222.0.62 () {56 vars in 1103 bytes} [Fri May 27 08:29:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:29:12.771027 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863decdc-72d1-4b48-aa8b-8894921e78d0 None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:29:12.826886 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:29:12.891194 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863decdc-72d1-4b48-aa8b-8894921e78d0 None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:29:12.935252 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f71631-3d8c-4c1f-a58a-e84c658d55c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:29:12.936399 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f71631-3d8c-4c1f-a58a-e84c658d55c5 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:29:12.936730 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f71631-3d8c-4c1f-a58a-e84c658d55c5 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:29:12.937034 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f71631-3d8c-4c1f-a58a-e84c658d55c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:29:12.951031 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f71631-3d8c-4c1f-a58a-e84c658d55c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:29:12.952571 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f71631-3d8c-4c1f-a58a-e84c658d55c5 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:29:12.971194 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application [None req-a3f71631-3d8c-4c1f-a58a-e84c658d55c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 08:29:12.971194 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:29:12.971194 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:29:12.971194 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:29:12.971194 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:29:12.971194 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:29:12.971194 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:29:12.971194 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:29:12.971194 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:29:12.971194 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:29:12.971194 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:29:12.971194 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:29:12.971194 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 08:29:12.971194 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 08:29:12.971194 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 08:29:12.972237 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 08:29:12.972237 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:29:12.972237 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:29:12.972237 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:29:12.972237 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:29:12.972237 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:29:12.972237 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:29:12.972237 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:29:12.972237 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application with Lock( May 27 08:29:12.972237 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:29:12.972237 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._enter() May 27 08:29:12.972237 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:29:12.972237 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:29:12.972237 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:29:12.972237 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.creator() May 27 08:29:12.972237 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:29:12.972237 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application created_value = creator( May 27 08:29:12.973582 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 08:29:12.973582 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 08:29:12.973582 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 08:29:12.973582 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application May 27 08:29:12.973582 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 415/831] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 08:29:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 08:29:12.981416 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceae1d2-f7ba-48fb-a506-b2f9ee6e336f None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:29:13.094542 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:29:13.097733 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceae1d2-f7ba-48fb-a506-b2f9ee6e336f None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:29:13.141636 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3490d9-f9b2-403a-a7c9-5d0e7fcd925b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:29:13.142390 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3490d9-f9b2-403a-a7c9-5d0e7fcd925b None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:29:13.142681 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3490d9-f9b2-403a-a7c9-5d0e7fcd925b None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:29:13.142962 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3490d9-f9b2-403a-a7c9-5d0e7fcd925b None admin] PATH_INFO: `/v3/domains` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:29:13.143699 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3490d9-f9b2-403a-a7c9-5d0e7fcd925b None admin] RBAC: Adding query filter params (name=Default) {{(pid=87173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:29:13.144009 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3490d9-f9b2-403a-a7c9-5d0e7fcd925b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:29:13.145449 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3490d9-f9b2-403a-a7c9-5d0e7fcd925b None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:29:13.162099 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 417/832] 10.222.0.62 () {56 vars in 1109 bytes} [Fri May 27 08:29:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:29:13.168459 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f71631-3d8c-4c1f-a58a-e84c658d55c5 None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:29:13.297540 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:29:13.302587 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f71631-3d8c-4c1f-a58a-e84c658d55c5 None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:29:13.349913 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2734f7ef-9a3c-42aa-b0af-5374b37e4451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:29:13.350691 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2734f7ef-9a3c-42aa-b0af-5374b37e4451 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:29:13.350977 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2734f7ef-9a3c-42aa-b0af-5374b37e4451 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:29:13.351254 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2734f7ef-9a3c-42aa-b0af-5374b37e4451 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:29:13.361548 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2734f7ef-9a3c-42aa-b0af-5374b37e4451 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:29:13.363114 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2734f7ef-9a3c-42aa-b0af-5374b37e4451 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:29:13.378228 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application [None req-2734f7ef-9a3c-42aa-b0af-5374b37e4451 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 27 08:29:13.378228 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:29:13.378228 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:29:13.378228 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:29:13.378228 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:29:13.378228 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:29:13.378228 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:29:13.378228 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:29:13.378228 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:29:13.378228 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:29:13.378228 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:29:13.378228 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:29:13.378228 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 08:29:13.378228 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 08:29:13.378228 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 08:29:13.378228 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 08:29:13.379411 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:29:13.379411 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:29:13.379411 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 08:29:13.379411 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 08:29:13.379411 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 08:29:13.379411 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 08:29:13.379411 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:29:13.379411 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:29:13.379411 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:29:13.379411 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:29:13.379411 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:29:13.379411 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application with Lock( May 27 08:29:13.379411 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:29:13.379411 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._enter() May 27 08:29:13.379411 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:29:13.379411 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:29:13.379411 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:29:13.379411 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.creator() May 27 08:29:13.380761 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:29:13.380761 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application created_value = creator( May 27 08:29:13.380761 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 08:29:13.380761 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 08:29:13.380761 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 08:29:13.380761 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 08:29:13.380761 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 08:29:13.380761 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 08:29:13.380761 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 27 08:29:13.380761 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application May 27 08:29:13.380761 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 416/833] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 08:29:13 2022] GET /identity/v3/users/placement => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 08:29:13.385159 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3490d9-f9b2-403a-a7c9-5d0e7fcd925b None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:29:13.494380 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3490d9-f9b2-403a-a7c9-5d0e7fcd925b None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:29:13.537818 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77c73c4-2568-4084-9bb3-07497b999712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:29:13.538493 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77c73c4-2568-4084-9bb3-07497b999712 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:29:13.538780 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77c73c4-2568-4084-9bb3-07497b999712 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:29:13.539061 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77c73c4-2568-4084-9bb3-07497b999712 None admin] PATH_INFO: `/v3/users` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:29:13.539895 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77c73c4-2568-4084-9bb3-07497b999712 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:29:13.540208 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77c73c4-2568-4084-9bb3-07497b999712 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:29:13.542288 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77c73c4-2568-4084-9bb3-07497b999712 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:29:13.561662 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 418/834] 10.222.0.62 () {56 vars in 1143 bytes} [Fri May 27 08:29:13 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:29:13.568151 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2734f7ef-9a3c-42aa-b0af-5374b37e4451 None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:29:13.690808 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2734f7ef-9a3c-42aa-b0af-5374b37e4451 None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:29:13.742294 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af2d9e1-8751-40ee-b135-77d618db6a30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:29:13.743136 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af2d9e1-8751-40ee-b135-77d618db6a30 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:29:13.743479 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af2d9e1-8751-40ee-b135-77d618db6a30 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:29:13.744179 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af2d9e1-8751-40ee-b135-77d618db6a30 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:29:13.773157 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:29:13.818030 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af2d9e1-8751-40ee-b135-77d618db6a30 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:29:13.819880 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af2d9e1-8751-40ee-b135-77d618db6a30 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:29:13.945045 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 417/835] 10.222.0.62 () {58 vars in 1282 bytes} [Fri May 27 08:29:13 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 08:29:13.946091 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77c73c4-2568-4084-9bb3-07497b999712 None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:29:13.968040 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:29:14.062482 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77c73c4-2568-4084-9bb3-07497b999712 None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:29:14.104901 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12be550c-5f9b-4898-8d21-2faf96792f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:29:14.105734 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12be550c-5f9b-4898-8d21-2faf96792f4c None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:29:14.106915 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12be550c-5f9b-4898-8d21-2faf96792f4c None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:29:14.107208 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12be550c-5f9b-4898-8d21-2faf96792f4c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:29:14.120818 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12be550c-5f9b-4898-8d21-2faf96792f4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:29:14.122733 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12be550c-5f9b-4898-8d21-2faf96792f4c None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:29:14.144124 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application [None req-12be550c-5f9b-4898-8d21-2faf96792f4c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 08:29:14.144124 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:29:14.144124 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:29:14.144124 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:29:14.144124 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:29:14.144124 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:29:14.144124 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:29:14.144124 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:29:14.144124 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:29:14.144124 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:29:14.144124 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:29:14.144124 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:29:14.144124 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 08:29:14.144124 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 08:29:14.144124 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 08:29:14.145397 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 08:29:14.145397 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:29:14.145397 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:29:14.145397 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:29:14.145397 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:29:14.145397 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:29:14.145397 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:29:14.145397 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:29:14.145397 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application with Lock( May 27 08:29:14.145397 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:29:14.145397 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._enter() May 27 08:29:14.145397 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:29:14.145397 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:29:14.145397 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:29:14.145397 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.creator() May 27 08:29:14.145397 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:29:14.145397 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application created_value = creator( May 27 08:29:14.151850 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 08:29:14.151850 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 08:29:14.151850 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 08:29:14.151850 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application May 27 08:29:14.151850 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 419/836] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 08:29:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 08:29:14.152213 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af2d9e1-8751-40ee-b135-77d618db6a30 None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:29:14.219660 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:29:14.267402 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af2d9e1-8751-40ee-b135-77d618db6a30 None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:29:14.307522 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb38adc-d8a8-4080-abab-4790439be4c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:29:14.308305 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb38adc-d8a8-4080-abab-4790439be4c9 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:29:14.308623 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb38adc-d8a8-4080-abab-4790439be4c9 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:29:14.308890 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb38adc-d8a8-4080-abab-4790439be4c9 None admin] PATH_INFO: `/v3/domains` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:29:14.309627 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb38adc-d8a8-4080-abab-4790439be4c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:29:14.309932 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb38adc-d8a8-4080-abab-4790439be4c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:29:14.311327 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb38adc-d8a8-4080-abab-4790439be4c9 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:29:14.324551 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 418/837] 10.222.0.62 () {56 vars in 1109 bytes} [Fri May 27 08:29:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:29:14.330614 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12be550c-5f9b-4898-8d21-2faf96792f4c None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:29:14.416339 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:29:14.454660 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12be550c-5f9b-4898-8d21-2faf96792f4c None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:29:14.496380 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b4c538-dc55-4ba8-9138-5a2aff4c4eb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:29:14.497138 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b4c538-dc55-4ba8-9138-5a2aff4c4eb6 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:29:14.497422 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b4c538-dc55-4ba8-9138-5a2aff4c4eb6 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:29:14.497701 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b4c538-dc55-4ba8-9138-5a2aff4c4eb6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:29:14.505206 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b4c538-dc55-4ba8-9138-5a2aff4c4eb6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:29:14.506968 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b4c538-dc55-4ba8-9138-5a2aff4c4eb6 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:29:14.524415 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application [None req-27b4c538-dc55-4ba8-9138-5a2aff4c4eb6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 08:29:14.524415 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:29:14.524415 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:29:14.524415 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:29:14.524415 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:29:14.524415 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:29:14.524415 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:29:14.524415 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:29:14.524415 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:29:14.524415 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:29:14.524415 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:29:14.524415 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:29:14.524415 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 08:29:14.524415 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 08:29:14.524415 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 08:29:14.526443 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 08:29:14.526443 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:29:14.526443 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:29:14.526443 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:29:14.526443 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:29:14.526443 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:29:14.526443 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:29:14.526443 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:29:14.526443 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application with Lock( May 27 08:29:14.526443 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:29:14.526443 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._enter() May 27 08:29:14.526443 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:29:14.526443 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:29:14.526443 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:29:14.526443 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.creator() May 27 08:29:14.526443 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:29:14.526443 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application created_value = creator( May 27 08:29:14.527544 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 08:29:14.527544 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 08:29:14.527544 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 08:29:14.527544 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 08:29:14.527544 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 08:29:14.527544 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 08:29:14.527544 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 08:29:14.527544 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application May 27 08:29:14.527544 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 420/838] 10.222.0.62 () {56 vars in 1111 bytes} [Fri May 27 08:29:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 08:29:14.532408 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb38adc-d8a8-4080-abab-4790439be4c9 None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:29:14.648257 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb38adc-d8a8-4080-abab-4790439be4c9 None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:29:14.670149 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:29:14.689513 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2f96e5-ec9d-4fb9-9665-735e035bf139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:29:14.690183 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2f96e5-ec9d-4fb9-9665-735e035bf139 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:29:14.690554 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2f96e5-ec9d-4fb9-9665-735e035bf139 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:29:14.690808 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2f96e5-ec9d-4fb9-9665-735e035bf139 None admin] PATH_INFO: `/v3/projects` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:29:14.691600 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2f96e5-ec9d-4fb9-9665-735e035bf139 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:29:14.691920 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2f96e5-ec9d-4fb9-9665-735e035bf139 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:29:14.693395 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2f96e5-ec9d-4fb9-9665-735e035bf139 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:29:14.708038 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 419/839] 10.222.0.62 () {56 vars in 1148 bytes} [Fri May 27 08:29:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:29:14.715680 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b4c538-dc55-4ba8-9138-5a2aff4c4eb6 None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:29:14.836509 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b4c538-dc55-4ba8-9138-5a2aff4c4eb6 None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:29:14.872374 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:29:14.881782 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2872cb98-9a1c-4f24-8a1f-d6f69b0c72df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:29:14.882632 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2872cb98-9a1c-4f24-8a1f-d6f69b0c72df None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:29:14.882921 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2872cb98-9a1c-4f24-8a1f-d6f69b0c72df None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:29:14.883821 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2872cb98-9a1c-4f24-8a1f-d6f69b0c72df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:29:14.884410 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2872cb98-9a1c-4f24-8a1f-d6f69b0c72df None admin] RBAC: Adding query filter params (role.id=d15a26a31e9f4cad8e2c934cf892d50d, scope.project.id=256f4731060449f1b80067e51e8bec00, user.id=7b12a598052a4b749edb0c021d99b951) {{(pid=87173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:29:14.884820 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2872cb98-9a1c-4f24-8a1f-d6f69b0c72df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:29:14.887039 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2872cb98-9a1c-4f24-8a1f-d6f69b0c72df None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:29:14.893436 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 421/840] 10.222.0.62 () {56 vars in 1374 bytes} [Fri May 27 08:29:14 2022] GET /identity/v3/role_assignments?user.id=7b12a598052a4b749edb0c021d99b951&scope.project.id=256f4731060449f1b80067e51e8bec00&role.id=d15a26a31e9f4cad8e2c934cf892d50d => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 08:29:17.234075 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f210a3a-ec99-4a63-832d-60ddf3af57f3 None None] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:29:17.234710 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f210a3a-ec99-4a63-832d-60ddf3af57f3 None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:29:17.234710 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f210a3a-ec99-4a63-832d-60ddf3af57f3 None None] PATH_INFO: `/` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:29:17.236120 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 420/841] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:29:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:29:17.241283 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4320549b-1f21-4156-9332-4b23864e81a3 None None] REQUEST_METHOD: `POST` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:29:17.241731 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4320549b-1f21-4156-9332-4b23864e81a3 None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:29:17.241854 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4320549b-1f21-4156-9332-4b23864e81a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:29:17.262835 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.auth.core [None req-4320549b-1f21-4156-9332-4b23864e81a3 None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:29:17.264495 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.fernet_utils [None req-4320549b-1f21-4156-9332-4b23864e81a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:29:17.344745 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 422/842] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:29:17 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 08:29:17.373302 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f210a3a-ec99-4a63-832d-60ddf3af57f3 None None] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:29:17.498876 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f210a3a-ec99-4a63-832d-60ddf3af57f3 None None] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:29:17.547605 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d23797-cda5-4fe3-8ca9-69561ce33529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:29:17.548493 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d23797-cda5-4fe3-8ca9-69561ce33529 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:29:17.548912 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d23797-cda5-4fe3-8ca9-69561ce33529 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:29:17.549202 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d23797-cda5-4fe3-8ca9-69561ce33529 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:29:17.562792 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d23797-cda5-4fe3-8ca9-69561ce33529 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 08:29:17.571537 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application [None req-b0d23797-cda5-4fe3-8ca9-69561ce33529 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 08:29:17.571537 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:29:17.571537 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:29:17.571537 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:29:17.571537 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:29:17.571537 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:29:17.571537 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:29:17.571537 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:29:17.571537 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:29:17.571537 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:29:17.571537 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:29:17.571537 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:29:17.571537 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 08:29:17.571537 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 08:29:17.571537 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 08:29:17.571537 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 08:29:17.573331 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 08:29:17.573331 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 08:29:17.573331 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 08:29:17.573331 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 08:29:17.573331 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:29:17.573331 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:29:17.573331 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:29:17.573331 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:29:17.573331 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:29:17.573331 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:29:17.573331 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:29:17.573331 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application with Lock( May 27 08:29:17.573331 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:29:17.573331 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._enter() May 27 08:29:17.573331 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:29:17.573331 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:29:17.574559 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:29:17.574559 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.creator() May 27 08:29:17.574559 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:29:17.574559 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application created_value = creator( May 27 08:29:17.574559 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 08:29:17.574559 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 08:29:17.574559 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 08:29:17.574559 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 08:29:17.574559 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 08:29:17.574559 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 08:29:17.574559 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 08:29:17.574559 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application May 27 08:29:17.574559 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 421/843] 10.222.0.62 () {56 vars in 1102 bytes} [Fri May 27 08:29:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 08:29:17.580294 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4320549b-1f21-4156-9332-4b23864e81a3 None None] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:29:17.705622 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4320549b-1f21-4156-9332-4b23864e81a3 None None] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:29:17.733136 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:29:17.749256 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15531c0d-f151-41b2-bbc5-7e3bdae5d2f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:29:17.749934 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15531c0d-f151-41b2-bbc5-7e3bdae5d2f1 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:29:17.750286 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15531c0d-f151-41b2-bbc5-7e3bdae5d2f1 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:29:17.750566 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15531c0d-f151-41b2-bbc5-7e3bdae5d2f1 None admin] PATH_INFO: `/v3/roles` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:29:17.751336 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15531c0d-f151-41b2-bbc5-7e3bdae5d2f1 None admin] RBAC: Adding query filter params (name=service) {{(pid=87173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:29:17.751642 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15531c0d-f151-41b2-bbc5-7e3bdae5d2f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:29:17.753375 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15531c0d-f151-41b2-bbc5-7e3bdae5d2f1 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:29:17.765965 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 423/844] 10.222.0.62 () {56 vars in 1103 bytes} [Fri May 27 08:29:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:29:17.773560 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d23797-cda5-4fe3-8ca9-69561ce33529 None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:29:17.836863 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:29:17.919638 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d23797-cda5-4fe3-8ca9-69561ce33529 None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:29:17.970348 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a25ab0d-8b47-466b-941e-e343d7e850d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:29:17.971415 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a25ab0d-8b47-466b-941e-e343d7e850d7 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:29:17.971788 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a25ab0d-8b47-466b-941e-e343d7e850d7 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:29:17.972153 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a25ab0d-8b47-466b-941e-e343d7e850d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:29:17.988094 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a25ab0d-8b47-466b-941e-e343d7e850d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:29:17.990127 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a25ab0d-8b47-466b-941e-e343d7e850d7 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:29:18.017673 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application [None req-6a25ab0d-8b47-466b-941e-e343d7e850d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 08:29:18.017673 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:29:18.017673 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:29:18.017673 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:29:18.017673 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:29:18.017673 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:29:18.017673 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:29:18.017673 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:29:18.017673 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:29:18.017673 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:29:18.017673 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:29:18.017673 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:29:18.017673 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 08:29:18.017673 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 08:29:18.017673 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 08:29:18.019603 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 08:29:18.019603 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:29:18.019603 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:29:18.019603 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:29:18.019603 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:29:18.019603 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:29:18.019603 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:29:18.019603 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:29:18.019603 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application with Lock( May 27 08:29:18.019603 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:29:18.019603 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._enter() May 27 08:29:18.019603 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:29:18.019603 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:29:18.019603 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:29:18.019603 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.creator() May 27 08:29:18.019603 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:29:18.019603 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application created_value = creator( May 27 08:29:18.021719 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 08:29:18.021719 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 08:29:18.021719 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 08:29:18.021719 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application May 27 08:29:18.024685 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 422/845] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 08:29:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 08:29:18.026619 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15531c0d-f151-41b2-bbc5-7e3bdae5d2f1 None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:29:18.162854 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15531c0d-f151-41b2-bbc5-7e3bdae5d2f1 None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:29:18.213274 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c87aecd-d06a-4352-8b5a-ef71b24eca22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:29:18.214277 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c87aecd-d06a-4352-8b5a-ef71b24eca22 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:29:18.214543 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c87aecd-d06a-4352-8b5a-ef71b24eca22 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:29:18.214815 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c87aecd-d06a-4352-8b5a-ef71b24eca22 None admin] PATH_INFO: `/v3/domains` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:29:18.215588 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c87aecd-d06a-4352-8b5a-ef71b24eca22 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:29:18.215891 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c87aecd-d06a-4352-8b5a-ef71b24eca22 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:29:18.217338 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c87aecd-d06a-4352-8b5a-ef71b24eca22 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:29:18.235030 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 424/846] 10.222.0.62 () {56 vars in 1109 bytes} [Fri May 27 08:29:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:29:18.240768 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a25ab0d-8b47-466b-941e-e343d7e850d7 None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:29:18.356022 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:29:18.367729 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a25ab0d-8b47-466b-941e-e343d7e850d7 None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:29:18.419515 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1102602f-bb93-4dce-862f-ce5ed5028868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:29:18.420579 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1102602f-bb93-4dce-862f-ce5ed5028868 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:29:18.421795 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1102602f-bb93-4dce-862f-ce5ed5028868 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:29:18.422077 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1102602f-bb93-4dce-862f-ce5ed5028868 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:29:18.430862 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1102602f-bb93-4dce-862f-ce5ed5028868 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:29:18.432940 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1102602f-bb93-4dce-862f-ce5ed5028868 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:29:18.449080 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application [None req-1102602f-bb93-4dce-862f-ce5ed5028868 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 27 08:29:18.449080 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:29:18.449080 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:29:18.449080 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:29:18.449080 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:29:18.449080 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:29:18.449080 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:29:18.449080 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:29:18.449080 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:29:18.449080 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:29:18.449080 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:29:18.449080 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:29:18.449080 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 08:29:18.449080 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 08:29:18.449080 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 08:29:18.449080 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 08:29:18.450314 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:29:18.450314 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:29:18.450314 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 08:29:18.450314 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 08:29:18.450314 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 08:29:18.450314 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 08:29:18.450314 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:29:18.450314 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:29:18.450314 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:29:18.450314 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:29:18.450314 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:29:18.450314 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application with Lock( May 27 08:29:18.450314 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:29:18.450314 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._enter() May 27 08:29:18.450314 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:29:18.450314 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:29:18.450314 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:29:18.450314 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.creator() May 27 08:29:18.451525 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:29:18.451525 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application created_value = creator( May 27 08:29:18.451525 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 08:29:18.451525 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 08:29:18.451525 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 08:29:18.451525 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 08:29:18.451525 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 08:29:18.451525 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 08:29:18.451525 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 27 08:29:18.451525 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application May 27 08:29:18.452771 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 423/847] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 08:29:18 2022] GET /identity/v3/users/placement => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 08:29:18.456625 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c87aecd-d06a-4352-8b5a-ef71b24eca22 None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:29:18.512549 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:29:18.578360 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c87aecd-d06a-4352-8b5a-ef71b24eca22 None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:29:18.619650 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b767dc-621d-4aa9-aa0b-8cb2cebd54e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:29:18.620334 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b767dc-621d-4aa9-aa0b-8cb2cebd54e4 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:29:18.621299 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b767dc-621d-4aa9-aa0b-8cb2cebd54e4 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:29:18.621299 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b767dc-621d-4aa9-aa0b-8cb2cebd54e4 None admin] PATH_INFO: `/v3/users` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:29:18.621900 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b767dc-621d-4aa9-aa0b-8cb2cebd54e4 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:29:18.622372 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b767dc-621d-4aa9-aa0b-8cb2cebd54e4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:29:18.623921 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b767dc-621d-4aa9-aa0b-8cb2cebd54e4 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:29:18.645875 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 425/848] 10.222.0.62 () {56 vars in 1143 bytes} [Fri May 27 08:29:18 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:29:18.651840 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1102602f-bb93-4dce-862f-ce5ed5028868 None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:29:18.790785 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1102602f-bb93-4dce-862f-ce5ed5028868 None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:29:18.832292 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aef9b19-5f7e-4c0c-8dc8-d151c1851f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:29:18.833341 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aef9b19-5f7e-4c0c-8dc8-d151c1851f9f None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:29:18.833659 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aef9b19-5f7e-4c0c-8dc8-d151c1851f9f None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:29:18.834142 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aef9b19-5f7e-4c0c-8dc8-d151c1851f9f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:29:18.846794 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aef9b19-5f7e-4c0c-8dc8-d151c1851f9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:29:18.848345 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aef9b19-5f7e-4c0c-8dc8-d151c1851f9f None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:29:18.869752 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application [None req-3aef9b19-5f7e-4c0c-8dc8-d151c1851f9f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 08:29:18.869752 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:29:18.869752 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:29:18.869752 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:29:18.869752 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:29:18.869752 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:29:18.869752 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:29:18.869752 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:29:18.869752 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:29:18.869752 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:29:18.869752 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:29:18.869752 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:29:18.869752 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 08:29:18.869752 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 08:29:18.869752 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 08:29:18.871285 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 08:29:18.871285 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:29:18.871285 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:29:18.871285 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:29:18.871285 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:29:18.871285 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:29:18.871285 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:29:18.871285 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:29:18.871285 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application with Lock( May 27 08:29:18.871285 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:29:18.871285 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._enter() May 27 08:29:18.871285 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:29:18.871285 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:29:18.871285 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:29:18.871285 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.creator() May 27 08:29:18.871285 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:29:18.871285 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application created_value = creator( May 27 08:29:18.872271 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 08:29:18.872271 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 08:29:18.872271 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 08:29:18.872271 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application May 27 08:29:18.872271 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 424/849] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 08:29:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 08:29:18.877780 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b767dc-621d-4aa9-aa0b-8cb2cebd54e4 None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:29:18.996679 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b767dc-621d-4aa9-aa0b-8cb2cebd54e4 None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:29:18.999764 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:29:19.043171 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c327d7-9f22-4e61-8e10-12c5d3c856c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:29:19.043976 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c327d7-9f22-4e61-8e10-12c5d3c856c1 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:29:19.044150 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c327d7-9f22-4e61-8e10-12c5d3c856c1 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:29:19.044428 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c327d7-9f22-4e61-8e10-12c5d3c856c1 None admin] PATH_INFO: `/v3/domains` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:29:19.045206 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c327d7-9f22-4e61-8e10-12c5d3c856c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:29:19.045522 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c327d7-9f22-4e61-8e10-12c5d3c856c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:29:19.046929 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c327d7-9f22-4e61-8e10-12c5d3c856c1 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:29:19.059271 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 426/850] 10.222.0.62 () {56 vars in 1109 bytes} [Fri May 27 08:29:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:29:19.065708 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aef9b19-5f7e-4c0c-8dc8-d151c1851f9f None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:29:19.068780 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:29:19.198433 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aef9b19-5f7e-4c0c-8dc8-d151c1851f9f None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:29:19.236994 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ba99eb-3122-4a88-8444-1e30afbf836d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:29:19.237797 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ba99eb-3122-4a88-8444-1e30afbf836d None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:29:19.238081 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ba99eb-3122-4a88-8444-1e30afbf836d None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:29:19.238356 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ba99eb-3122-4a88-8444-1e30afbf836d None admin] PATH_INFO: `/v3/projects/service` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:29:19.246672 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ba99eb-3122-4a88-8444-1e30afbf836d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:29:19.248169 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ba99eb-3122-4a88-8444-1e30afbf836d None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:29:19.266859 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application [None req-61ba99eb-3122-4a88-8444-1e30afbf836d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 08:29:19.266859 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:29:19.266859 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:29:19.266859 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:29:19.266859 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:29:19.266859 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:29:19.266859 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:29:19.266859 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:29:19.266859 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:29:19.266859 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:29:19.266859 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:29:19.266859 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:29:19.266859 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 08:29:19.266859 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 08:29:19.266859 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 08:29:19.268151 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 08:29:19.268151 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:29:19.268151 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:29:19.268151 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:29:19.268151 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:29:19.268151 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:29:19.268151 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:29:19.268151 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:29:19.268151 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application with Lock( May 27 08:29:19.268151 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:29:19.268151 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._enter() May 27 08:29:19.268151 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:29:19.268151 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:29:19.268151 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:29:19.268151 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.creator() May 27 08:29:19.268151 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:29:19.268151 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application created_value = creator( May 27 08:29:19.269275 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 08:29:19.269275 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 08:29:19.269275 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 08:29:19.269275 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 08:29:19.269275 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 08:29:19.269275 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 08:29:19.269275 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 08:29:19.269275 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application May 27 08:29:19.269275 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 425/851] 10.222.0.62 () {56 vars in 1111 bytes} [Fri May 27 08:29:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 08:29:19.275425 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c327d7-9f22-4e61-8e10-12c5d3c856c1 None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:29:19.407214 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c327d7-9f22-4e61-8e10-12c5d3c856c1 None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:29:19.447662 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d373dd3-3d27-4e0a-bcc3-0c9490277622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:29:19.448783 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d373dd3-3d27-4e0a-bcc3-0c9490277622 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:29:19.449132 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d373dd3-3d27-4e0a-bcc3-0c9490277622 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:29:19.449552 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d373dd3-3d27-4e0a-bcc3-0c9490277622 None admin] PATH_INFO: `/v3/projects` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:29:19.450415 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d373dd3-3d27-4e0a-bcc3-0c9490277622 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:29:19.450722 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d373dd3-3d27-4e0a-bcc3-0c9490277622 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:29:19.452183 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d373dd3-3d27-4e0a-bcc3-0c9490277622 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:29:19.467061 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 427/852] 10.222.0.62 () {56 vars in 1148 bytes} [Fri May 27 08:29:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:29:19.473336 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ba99eb-3122-4a88-8444-1e30afbf836d None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:29:19.546409 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:29:19.592617 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ba99eb-3122-4a88-8444-1e30afbf836d None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:29:19.638907 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c312a1-1ec1-446d-9f72-da07b011095e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:29:19.639939 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c312a1-1ec1-446d-9f72-da07b011095e None admin] REQUEST_METHOD: `PUT` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:29:19.641616 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c312a1-1ec1-446d-9f72-da07b011095e None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:29:19.641616 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c312a1-1ec1-446d-9f72-da07b011095e None admin] PATH_INFO: `/v3/projects/256f4731060449f1b80067e51e8bec00/users/7b12a598052a4b749edb0c021d99b951/roles/d15a26a31e9f4cad8e2c934cf892d50d` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:29:19.660194 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c312a1-1ec1-446d-9f72-da07b011095e None admin] RBAC: Authorizing `identity:create_grant(project_id=256f4731060449f1b80067e51e8bec00, user_id=7b12a598052a4b749edb0c021d99b951, role_id=d15a26a31e9f4cad8e2c934cf892d50d)` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:29:19.661829 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c312a1-1ec1-446d-9f72-da07b011095e None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:29:19.680073 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 426/853] 10.222.0.62 () {58 vars in 1439 bytes} [Fri May 27 08:29:19 2022] PUT /identity/v3/projects/256f4731060449f1b80067e51e8bec00/users/7b12a598052a4b749edb0c021d99b951/roles/d15a26a31e9f4cad8e2c934cf892d50d => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 08:29:22.078778 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43adaa69-67c1-44bf-b495-8263ad15b5cc None None] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:29:22.079453 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43adaa69-67c1-44bf-b495-8263ad15b5cc None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:29:22.079453 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43adaa69-67c1-44bf-b495-8263ad15b5cc None None] PATH_INFO: `/` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:29:22.080945 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 428/854] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:29:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 08:29:22.086611 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dd0a52-08ce-4eb6-b07a-f8752b9d0dd6 None None] REQUEST_METHOD: `POST` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:29:22.087068 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dd0a52-08ce-4eb6-b07a-f8752b9d0dd6 None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:29:22.087188 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dd0a52-08ce-4eb6-b07a-f8752b9d0dd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:29:22.105060 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.auth.core [None req-84dd0a52-08ce-4eb6-b07a-f8752b9d0dd6 None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:29:22.106277 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.fernet_utils [None req-84dd0a52-08ce-4eb6-b07a-f8752b9d0dd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:29:22.179214 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 427/855] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:29:22 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 08:29:22.206346 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43adaa69-67c1-44bf-b495-8263ad15b5cc None None] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:29:22.238334 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:29:22.342328 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43adaa69-67c1-44bf-b495-8263ad15b5cc None None] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:29:22.380610 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d61a489-37af-4001-b32c-79678ae92662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:29:22.381485 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d61a489-37af-4001-b32c-79678ae92662 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:29:22.381774 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d61a489-37af-4001-b32c-79678ae92662 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:29:22.382093 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d61a489-37af-4001-b32c-79678ae92662 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:29:22.393337 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d61a489-37af-4001-b32c-79678ae92662 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 08:29:22.402332 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application [None req-4d61a489-37af-4001-b32c-79678ae92662 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 27 08:29:22.402332 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:29:22.402332 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:29:22.402332 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:29:22.402332 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:29:22.402332 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:29:22.402332 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:29:22.402332 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:29:22.402332 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:29:22.402332 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:29:22.402332 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:29:22.402332 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:29:22.402332 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 08:29:22.402332 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 08:29:22.402332 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 08:29:22.402332 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 08:29:22.403484 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 08:29:22.403484 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 08:29:22.403484 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 08:29:22.403484 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 08:29:22.403484 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:29:22.403484 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:29:22.403484 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:29:22.403484 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:29:22.403484 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:29:22.403484 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:29:22.403484 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:29:22.403484 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application with Lock( May 27 08:29:22.403484 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:29:22.403484 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._enter() May 27 08:29:22.403484 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:29:22.403484 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:29:22.404537 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:29:22.404537 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.creator() May 27 08:29:22.404537 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:29:22.404537 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application created_value = creator( May 27 08:29:22.404537 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 08:29:22.404537 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 08:29:22.404537 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 08:29:22.404537 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 08:29:22.404537 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 08:29:22.404537 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 08:29:22.404537 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 27 08:29:22.404537 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application May 27 08:29:22.404537 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 429/856] 10.222.0.62 () {56 vars in 1102 bytes} [Fri May 27 08:29:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 08:29:22.410679 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dd0a52-08ce-4eb6-b07a-f8752b9d0dd6 None None] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:29:22.459268 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:29:22.521853 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dd0a52-08ce-4eb6-b07a-f8752b9d0dd6 None None] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:29:22.567935 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee4a2be-292a-4bf5-bc13-9d3182bd6437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:29:22.568820 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee4a2be-292a-4bf5-bc13-9d3182bd6437 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:29:22.569105 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee4a2be-292a-4bf5-bc13-9d3182bd6437 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:29:22.569383 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee4a2be-292a-4bf5-bc13-9d3182bd6437 None admin] PATH_INFO: `/v3/roles` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:29:22.570132 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee4a2be-292a-4bf5-bc13-9d3182bd6437 None admin] RBAC: Adding query filter params (name=service) {{(pid=87172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:29:22.570436 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee4a2be-292a-4bf5-bc13-9d3182bd6437 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:29:22.571958 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee4a2be-292a-4bf5-bc13-9d3182bd6437 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:29:22.580757 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 428/857] 10.222.0.62 () {56 vars in 1103 bytes} [Fri May 27 08:29:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:29:22.586504 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d61a489-37af-4001-b32c-79678ae92662 None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:29:22.688151 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:29:22.710785 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d61a489-37af-4001-b32c-79678ae92662 None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:29:22.755100 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bb5493-46d8-4aa1-832d-4ee18c71e63b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:29:22.755891 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bb5493-46d8-4aa1-832d-4ee18c71e63b None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:29:22.756184 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bb5493-46d8-4aa1-832d-4ee18c71e63b None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:29:22.756438 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bb5493-46d8-4aa1-832d-4ee18c71e63b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:29:22.767483 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bb5493-46d8-4aa1-832d-4ee18c71e63b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:29:22.769309 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bb5493-46d8-4aa1-832d-4ee18c71e63b None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:29:22.793547 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application [None req-67bb5493-46d8-4aa1-832d-4ee18c71e63b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 08:29:22.793547 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:29:22.793547 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:29:22.793547 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:29:22.793547 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:29:22.793547 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:29:22.793547 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:29:22.793547 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:29:22.793547 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:29:22.793547 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:29:22.793547 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:29:22.793547 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:29:22.793547 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 08:29:22.793547 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 08:29:22.793547 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 08:29:22.794683 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 08:29:22.794683 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:29:22.794683 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:29:22.794683 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:29:22.794683 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:29:22.794683 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:29:22.794683 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:29:22.794683 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:29:22.794683 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application with Lock( May 27 08:29:22.794683 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:29:22.794683 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._enter() May 27 08:29:22.794683 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:29:22.794683 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:29:22.794683 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:29:22.794683 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.creator() May 27 08:29:22.794683 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:29:22.794683 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application created_value = creator( May 27 08:29:22.795680 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 08:29:22.795680 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 08:29:22.795680 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 08:29:22.795680 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application May 27 08:29:22.795680 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 430/858] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 08:29:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 08:29:22.801491 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee4a2be-292a-4bf5-bc13-9d3182bd6437 None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:29:22.955665 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee4a2be-292a-4bf5-bc13-9d3182bd6437 None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:29:22.958423 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:29:23.000322 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fcc104-e975-43f3-9002-d302b5f01337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:29:23.001057 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fcc104-e975-43f3-9002-d302b5f01337 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:29:23.001347 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fcc104-e975-43f3-9002-d302b5f01337 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:29:23.001628 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fcc104-e975-43f3-9002-d302b5f01337 None admin] PATH_INFO: `/v3/domains` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:29:23.002498 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fcc104-e975-43f3-9002-d302b5f01337 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:29:23.002811 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fcc104-e975-43f3-9002-d302b5f01337 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:29:23.004392 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fcc104-e975-43f3-9002-d302b5f01337 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:29:23.018827 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 429/859] 10.222.0.62 () {56 vars in 1109 bytes} [Fri May 27 08:29:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:29:23.024812 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bb5493-46d8-4aa1-832d-4ee18c71e63b None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:29:23.133079 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bb5493-46d8-4aa1-832d-4ee18c71e63b None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:29:23.168781 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7dbe30-f142-4e5f-a74c-d4c01293e8e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:29:23.169588 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7dbe30-f142-4e5f-a74c-d4c01293e8e4 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:29:23.169867 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7dbe30-f142-4e5f-a74c-d4c01293e8e4 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:29:23.170139 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7dbe30-f142-4e5f-a74c-d4c01293e8e4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:29:23.172954 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:29:23.178459 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7dbe30-f142-4e5f-a74c-d4c01293e8e4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:29:23.179984 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7dbe30-f142-4e5f-a74c-d4c01293e8e4 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:29:23.195600 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application [None req-cb7dbe30-f142-4e5f-a74c-d4c01293e8e4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 27 08:29:23.195600 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:29:23.195600 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:29:23.195600 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:29:23.195600 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:29:23.195600 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:29:23.195600 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:29:23.195600 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:29:23.195600 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:29:23.195600 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:29:23.195600 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:29:23.195600 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:29:23.195600 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 08:29:23.195600 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 08:29:23.195600 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 08:29:23.195600 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 08:29:23.196898 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:29:23.196898 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:29:23.196898 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 08:29:23.196898 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 08:29:23.196898 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 08:29:23.196898 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 08:29:23.196898 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:29:23.196898 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:29:23.196898 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:29:23.196898 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:29:23.196898 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:29:23.196898 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application with Lock( May 27 08:29:23.196898 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:29:23.196898 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._enter() May 27 08:29:23.196898 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:29:23.196898 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:29:23.196898 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:29:23.196898 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.creator() May 27 08:29:23.203171 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:29:23.203171 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application created_value = creator( May 27 08:29:23.203171 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 08:29:23.203171 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 08:29:23.203171 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 08:29:23.203171 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 08:29:23.203171 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 08:29:23.203171 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 08:29:23.203171 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 27 08:29:23.203171 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application May 27 08:29:23.203171 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 431/860] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 08:29:23 2022] GET /identity/v3/users/placement => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 08:29:23.204054 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fcc104-e975-43f3-9002-d302b5f01337 None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:29:23.323785 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fcc104-e975-43f3-9002-d302b5f01337 None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:29:23.358402 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6503f6fc-8270-45bc-89ed-bff23fa74b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:29:23.359076 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6503f6fc-8270-45bc-89ed-bff23fa74b1f None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:29:23.359363 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6503f6fc-8270-45bc-89ed-bff23fa74b1f None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:29:23.359640 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6503f6fc-8270-45bc-89ed-bff23fa74b1f None admin] PATH_INFO: `/v3/users` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:29:23.360485 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6503f6fc-8270-45bc-89ed-bff23fa74b1f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:29:23.360954 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6503f6fc-8270-45bc-89ed-bff23fa74b1f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:29:23.362402 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6503f6fc-8270-45bc-89ed-bff23fa74b1f None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:29:23.381481 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 430/861] 10.222.0.62 () {56 vars in 1143 bytes} [Fri May 27 08:29:23 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:29:23.387822 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7dbe30-f142-4e5f-a74c-d4c01293e8e4 None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:29:23.502400 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7dbe30-f142-4e5f-a74c-d4c01293e8e4 None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:29:23.548360 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6819ca7-4241-4bb5-bffc-03b72bbbe2dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:29:23.549093 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6819ca7-4241-4bb5-bffc-03b72bbbe2dc None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:29:23.549416 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6819ca7-4241-4bb5-bffc-03b72bbbe2dc None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:29:23.549884 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6819ca7-4241-4bb5-bffc-03b72bbbe2dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:29:23.624899 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:29:23.633537 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6819ca7-4241-4bb5-bffc-03b72bbbe2dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:29:23.636066 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6819ca7-4241-4bb5-bffc-03b72bbbe2dc None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:29:23.754366 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 432/862] 10.222.0.62 () {58 vars in 1282 bytes} [Fri May 27 08:29:23 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 27 08:29:23.760667 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6503f6fc-8270-45bc-89ed-bff23fa74b1f None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:29:23.793278 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:29:23.909253 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6503f6fc-8270-45bc-89ed-bff23fa74b1f None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:29:23.953201 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08319f55-3e76-45d9-80df-04de1eda2b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:29:23.954153 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08319f55-3e76-45d9-80df-04de1eda2b0a None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:29:23.954443 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08319f55-3e76-45d9-80df-04de1eda2b0a None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:29:23.954756 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08319f55-3e76-45d9-80df-04de1eda2b0a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:29:23.967342 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08319f55-3e76-45d9-80df-04de1eda2b0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:29:23.968851 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08319f55-3e76-45d9-80df-04de1eda2b0a None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:29:23.990376 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application [None req-08319f55-3e76-45d9-80df-04de1eda2b0a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 08:29:23.990376 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:29:23.990376 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:29:23.990376 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:29:23.990376 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:29:23.990376 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:29:23.990376 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:29:23.990376 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:29:23.990376 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:29:23.990376 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:29:23.990376 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:29:23.990376 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:29:23.990376 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 08:29:23.990376 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 08:29:23.990376 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 08:29:23.991780 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 08:29:23.991780 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:29:23.991780 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:29:23.991780 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:29:23.991780 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:29:23.991780 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:29:23.991780 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:29:23.991780 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:29:23.991780 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application with Lock( May 27 08:29:23.991780 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:29:23.991780 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._enter() May 27 08:29:23.991780 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:29:23.991780 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:29:23.991780 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:29:23.991780 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.creator() May 27 08:29:23.991780 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:29:23.991780 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application created_value = creator( May 27 08:29:23.993163 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 08:29:23.993163 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 08:29:23.993163 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 08:29:23.993163 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application May 27 08:29:23.993163 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 431/863] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 08:29:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 08:29:23.999019 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6819ca7-4241-4bb5-bffc-03b72bbbe2dc None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:29:24.113192 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:29:24.121420 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6819ca7-4241-4bb5-bffc-03b72bbbe2dc None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:29:24.162495 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cbf5bd-cbb3-4477-91ce-7c143899fe95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:29:24.163549 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cbf5bd-cbb3-4477-91ce-7c143899fe95 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:29:24.163549 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cbf5bd-cbb3-4477-91ce-7c143899fe95 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:29:24.163549 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cbf5bd-cbb3-4477-91ce-7c143899fe95 None admin] PATH_INFO: `/v3/domains` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:29:24.164298 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cbf5bd-cbb3-4477-91ce-7c143899fe95 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:29:24.164643 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cbf5bd-cbb3-4477-91ce-7c143899fe95 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:29:24.166250 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cbf5bd-cbb3-4477-91ce-7c143899fe95 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:29:24.189944 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 433/864] 10.222.0.62 () {56 vars in 1109 bytes} [Fri May 27 08:29:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:29:24.191739 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08319f55-3e76-45d9-80df-04de1eda2b0a None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:29:24.287667 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:29:24.329809 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08319f55-3e76-45d9-80df-04de1eda2b0a None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:29:24.370360 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab93e3f2-770b-46d7-82ce-36b27afb9c2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:29:24.371233 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab93e3f2-770b-46d7-82ce-36b27afb9c2e None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:29:24.371521 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab93e3f2-770b-46d7-82ce-36b27afb9c2e None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:29:24.371797 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab93e3f2-770b-46d7-82ce-36b27afb9c2e None admin] PATH_INFO: `/v3/projects/service` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:29:24.380354 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab93e3f2-770b-46d7-82ce-36b27afb9c2e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:29:24.382064 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab93e3f2-770b-46d7-82ce-36b27afb9c2e None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:29:24.400955 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application [None req-ab93e3f2-770b-46d7-82ce-36b27afb9c2e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 08:29:24.400955 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:29:24.400955 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:29:24.400955 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:29:24.400955 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:29:24.400955 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:29:24.400955 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:29:24.400955 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:29:24.400955 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:29:24.400955 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:29:24.400955 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:29:24.400955 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:29:24.400955 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 08:29:24.400955 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 08:29:24.400955 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 08:29:24.402045 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 08:29:24.402045 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:29:24.402045 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:29:24.402045 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:29:24.402045 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:29:24.402045 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:29:24.402045 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:29:24.402045 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:29:24.402045 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application with Lock( May 27 08:29:24.402045 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:29:24.402045 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._enter() May 27 08:29:24.402045 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:29:24.402045 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:29:24.402045 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:29:24.402045 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.creator() May 27 08:29:24.402045 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:29:24.402045 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application created_value = creator( May 27 08:29:24.403015 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 08:29:24.403015 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 08:29:24.403015 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 08:29:24.403015 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 08:29:24.403015 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 08:29:24.403015 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 08:29:24.403015 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 08:29:24.403015 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application May 27 08:29:24.403015 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 432/865] 10.222.0.62 () {56 vars in 1111 bytes} [Fri May 27 08:29:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 08:29:24.409104 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cbf5bd-cbb3-4477-91ce-7c143899fe95 None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:29:24.527801 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cbf5bd-cbb3-4477-91ce-7c143899fe95 None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:29:24.570797 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de411c1-dc39-481c-a659-0f7b2dfe7bf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:29:24.571574 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de411c1-dc39-481c-a659-0f7b2dfe7bf6 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:29:24.572164 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de411c1-dc39-481c-a659-0f7b2dfe7bf6 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:29:24.572561 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de411c1-dc39-481c-a659-0f7b2dfe7bf6 None admin] PATH_INFO: `/v3/projects` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:29:24.573686 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de411c1-dc39-481c-a659-0f7b2dfe7bf6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:29:24.574148 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de411c1-dc39-481c-a659-0f7b2dfe7bf6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:29:24.575941 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de411c1-dc39-481c-a659-0f7b2dfe7bf6 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:29:24.596623 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 434/866] 10.222.0.62 () {56 vars in 1148 bytes} [Fri May 27 08:29:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:29:24.600780 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab93e3f2-770b-46d7-82ce-36b27afb9c2e None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:29:24.726072 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab93e3f2-770b-46d7-82ce-36b27afb9c2e None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:29:24.767389 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570e221a-2ff5-4ead-96e4-bb8c7476b3e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:29:24.768048 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570e221a-2ff5-4ead-96e4-bb8c7476b3e0 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:29:24.768334 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570e221a-2ff5-4ead-96e4-bb8c7476b3e0 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:29:24.768625 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570e221a-2ff5-4ead-96e4-bb8c7476b3e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:29:24.769456 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570e221a-2ff5-4ead-96e4-bb8c7476b3e0 None admin] RBAC: Adding query filter params (role.id=d15a26a31e9f4cad8e2c934cf892d50d, scope.project.id=256f4731060449f1b80067e51e8bec00, user.id=7b12a598052a4b749edb0c021d99b951) {{(pid=87172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:29:24.769767 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570e221a-2ff5-4ead-96e4-bb8c7476b3e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:29:24.771213 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570e221a-2ff5-4ead-96e4-bb8c7476b3e0 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:29:24.773169 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:29:24.778823 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 433/867] 10.222.0.62 () {56 vars in 1374 bytes} [Fri May 27 08:29:24 2022] GET /identity/v3/role_assignments?user.id=7b12a598052a4b749edb0c021d99b951&scope.project.id=256f4731060449f1b80067e51e8bec00&role.id=d15a26a31e9f4cad8e2c934cf892d50d => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:29:27.235201 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1b9039-91f5-4ab7-97a4-25ad76d80336 None None] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:29:27.235744 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1b9039-91f5-4ab7-97a4-25ad76d80336 None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:29:27.235867 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1b9039-91f5-4ab7-97a4-25ad76d80336 None None] PATH_INFO: `/` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:29:27.237193 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 435/868] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:29:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:29:27.242453 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43486b6-39d3-4b86-bdee-68fe34e36bad None None] REQUEST_METHOD: `POST` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:29:27.242859 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43486b6-39d3-4b86-bdee-68fe34e36bad None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:29:27.243044 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43486b6-39d3-4b86-bdee-68fe34e36bad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:29:27.264251 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.auth.core [None req-e43486b6-39d3-4b86-bdee-68fe34e36bad None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:29:27.265800 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.fernet_utils [None req-e43486b6-39d3-4b86-bdee-68fe34e36bad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:29:27.358262 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 434/869] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:29:27 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 08:29:27.387048 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1b9039-91f5-4ab7-97a4-25ad76d80336 None None] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:29:27.407270 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:29:27.506417 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1b9039-91f5-4ab7-97a4-25ad76d80336 None None] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:29:27.555558 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80965ff-92ee-4502-b921-dc845ef45dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:29:27.556617 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80965ff-92ee-4502-b921-dc845ef45dae None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:29:27.557063 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80965ff-92ee-4502-b921-dc845ef45dae None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:29:27.557453 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80965ff-92ee-4502-b921-dc845ef45dae None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:29:27.569597 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80965ff-92ee-4502-b921-dc845ef45dae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 08:29:27.579000 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application [None req-e80965ff-92ee-4502-b921-dc845ef45dae None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 08:29:27.579000 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:29:27.579000 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:29:27.579000 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:29:27.579000 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:29:27.579000 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:29:27.579000 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:29:27.579000 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:29:27.579000 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:29:27.579000 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:29:27.579000 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:29:27.579000 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:29:27.579000 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 08:29:27.579000 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 08:29:27.579000 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 08:29:27.579000 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 08:29:27.580291 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 08:29:27.580291 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 08:29:27.580291 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 08:29:27.580291 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 08:29:27.580291 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:29:27.580291 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:29:27.580291 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:29:27.580291 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:29:27.580291 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:29:27.580291 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:29:27.580291 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:29:27.580291 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application with Lock( May 27 08:29:27.580291 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:29:27.580291 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._enter() May 27 08:29:27.580291 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:29:27.580291 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:29:27.581512 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:29:27.581512 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.creator() May 27 08:29:27.581512 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:29:27.581512 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application created_value = creator( May 27 08:29:27.581512 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 08:29:27.581512 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 08:29:27.581512 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 08:29:27.581512 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 08:29:27.581512 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 08:29:27.581512 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 08:29:27.581512 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 08:29:27.581512 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application May 27 08:29:27.581512 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 436/870] 10.222.0.62 () {56 vars in 1096 bytes} [Fri May 27 08:29:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 08:29:27.586368 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43486b6-39d3-4b86-bdee-68fe34e36bad None None] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:29:27.709040 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43486b6-39d3-4b86-bdee-68fe34e36bad None None] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:29:27.738611 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:29:27.748603 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43649573-fdb1-4c4e-9327-fb5d957914ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:29:27.749327 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43649573-fdb1-4c4e-9327-fb5d957914ca None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:29:27.749636 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43649573-fdb1-4c4e-9327-fb5d957914ca None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:29:27.749881 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43649573-fdb1-4c4e-9327-fb5d957914ca None admin] PATH_INFO: `/v3/roles` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:29:27.750708 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43649573-fdb1-4c4e-9327-fb5d957914ca None admin] RBAC: Adding query filter params (name=admin) {{(pid=87172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:29:27.751020 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43649573-fdb1-4c4e-9327-fb5d957914ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:29:27.752415 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43649573-fdb1-4c4e-9327-fb5d957914ca None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:29:27.762352 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 435/871] 10.222.0.62 () {56 vars in 1099 bytes} [Fri May 27 08:29:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:29:27.769776 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80965ff-92ee-4502-b921-dc845ef45dae None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:29:27.855546 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:29:27.887455 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80965ff-92ee-4502-b921-dc845ef45dae None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:29:27.930513 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60966924-bfaa-4747-a780-f514987f1945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:29:27.931851 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60966924-bfaa-4747-a780-f514987f1945 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:29:27.932333 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60966924-bfaa-4747-a780-f514987f1945 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:29:27.932885 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60966924-bfaa-4747-a780-f514987f1945 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:29:27.948139 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60966924-bfaa-4747-a780-f514987f1945 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:29:27.949858 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60966924-bfaa-4747-a780-f514987f1945 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:29:27.970689 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application [None req-60966924-bfaa-4747-a780-f514987f1945 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 08:29:27.970689 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:29:27.970689 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:29:27.970689 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:29:27.970689 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:29:27.970689 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:29:27.970689 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:29:27.970689 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:29:27.970689 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:29:27.970689 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:29:27.970689 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:29:27.970689 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:29:27.970689 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 08:29:27.970689 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 08:29:27.970689 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 08:29:27.972507 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 08:29:27.972507 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:29:27.972507 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:29:27.972507 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:29:27.972507 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:29:27.972507 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:29:27.972507 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:29:27.972507 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:29:27.972507 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application with Lock( May 27 08:29:27.972507 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:29:27.972507 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._enter() May 27 08:29:27.972507 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:29:27.972507 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:29:27.972507 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:29:27.972507 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.creator() May 27 08:29:27.972507 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:29:27.972507 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application created_value = creator( May 27 08:29:27.974417 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 08:29:27.974417 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 08:29:27.974417 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 08:29:27.974417 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application May 27 08:29:27.976747 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 437/872] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 08:29:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 08:29:27.977782 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43649573-fdb1-4c4e-9327-fb5d957914ca None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:29:28.104387 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43649573-fdb1-4c4e-9327-fb5d957914ca None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:29:28.144699 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b40c86-b6dd-4b8b-b74c-65d6329b653e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:29:28.145415 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b40c86-b6dd-4b8b-b74c-65d6329b653e None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:29:28.145648 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b40c86-b6dd-4b8b-b74c-65d6329b653e None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:29:28.145929 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b40c86-b6dd-4b8b-b74c-65d6329b653e None admin] PATH_INFO: `/v3/domains` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:29:28.146669 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b40c86-b6dd-4b8b-b74c-65d6329b653e None admin] RBAC: Adding query filter params (name=Default) {{(pid=87172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:29:28.146968 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b40c86-b6dd-4b8b-b74c-65d6329b653e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:29:28.148346 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b40c86-b6dd-4b8b-b74c-65d6329b653e None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:29:28.160873 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 436/873] 10.222.0.62 () {56 vars in 1109 bytes} [Fri May 27 08:29:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:29:28.167693 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60966924-bfaa-4747-a780-f514987f1945 None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:29:28.282517 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60966924-bfaa-4747-a780-f514987f1945 None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:29:28.314664 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:29:28.325904 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f000cab-5489-4c50-b275-e43ba6c1f10a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:29:28.326933 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f000cab-5489-4c50-b275-e43ba6c1f10a None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:29:28.327275 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f000cab-5489-4c50-b275-e43ba6c1f10a None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:29:28.327585 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f000cab-5489-4c50-b275-e43ba6c1f10a None admin] PATH_INFO: `/v3/users/placement` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:29:28.337360 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f000cab-5489-4c50-b275-e43ba6c1f10a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:29:28.339493 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f000cab-5489-4c50-b275-e43ba6c1f10a None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:29:28.356624 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application [None req-2f000cab-5489-4c50-b275-e43ba6c1f10a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 27 08:29:28.356624 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:29:28.356624 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:29:28.356624 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:29:28.356624 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:29:28.356624 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:29:28.356624 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:29:28.356624 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:29:28.356624 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:29:28.356624 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:29:28.356624 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:29:28.356624 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:29:28.356624 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 08:29:28.356624 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 08:29:28.356624 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 08:29:28.356624 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 08:29:28.357772 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:29:28.357772 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:29:28.357772 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 08:29:28.357772 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 08:29:28.357772 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 08:29:28.357772 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 08:29:28.357772 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:29:28.357772 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:29:28.357772 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:29:28.357772 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:29:28.357772 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:29:28.357772 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application with Lock( May 27 08:29:28.357772 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:29:28.357772 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._enter() May 27 08:29:28.357772 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:29:28.357772 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:29:28.357772 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:29:28.357772 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.creator() May 27 08:29:28.358934 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:29:28.358934 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application created_value = creator( May 27 08:29:28.358934 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 08:29:28.358934 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 08:29:28.358934 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 08:29:28.358934 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 08:29:28.358934 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 08:29:28.358934 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 08:29:28.358934 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 27 08:29:28.358934 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application May 27 08:29:28.358934 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 438/874] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 08:29:28 2022] GET /identity/v3/users/placement => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 08:29:28.363887 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b40c86-b6dd-4b8b-b74c-65d6329b653e None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:29:28.423326 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:29:28.475616 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b40c86-b6dd-4b8b-b74c-65d6329b653e None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:29:28.516194 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45b3730-ef4e-440b-b104-69541ba541c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:29:28.517020 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45b3730-ef4e-440b-b104-69541ba541c6 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:29:28.517315 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45b3730-ef4e-440b-b104-69541ba541c6 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:29:28.517593 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45b3730-ef4e-440b-b104-69541ba541c6 None admin] PATH_INFO: `/v3/users` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:29:28.518476 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45b3730-ef4e-440b-b104-69541ba541c6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:29:28.518785 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45b3730-ef4e-440b-b104-69541ba541c6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:29:28.520350 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45b3730-ef4e-440b-b104-69541ba541c6 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:29:28.540457 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 437/875] 10.222.0.62 () {56 vars in 1143 bytes} [Fri May 27 08:29:28 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:29:28.548648 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f000cab-5489-4c50-b275-e43ba6c1f10a None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:29:28.688023 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f000cab-5489-4c50-b275-e43ba6c1f10a None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:29:28.727457 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba30e92-01ed-40c4-86b0-70506b1e8b0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:29:28.728690 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba30e92-01ed-40c4-86b0-70506b1e8b0e None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:29:28.728979 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba30e92-01ed-40c4-86b0-70506b1e8b0e None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:29:28.729262 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba30e92-01ed-40c4-86b0-70506b1e8b0e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:29:28.792934 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:29:28.807494 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba30e92-01ed-40c4-86b0-70506b1e8b0e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:29:28.809149 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba30e92-01ed-40c4-86b0-70506b1e8b0e None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:29:28.941612 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 439/876] 10.222.0.62 () {58 vars in 1282 bytes} [Fri May 27 08:29:28 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 08:29:28.948188 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45b3730-ef4e-440b-b104-69541ba541c6 None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:29:29.063882 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45b3730-ef4e-440b-b104-69541ba541c6 None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:29:29.073744 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:29:29.100036 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06cb45e-2cd4-41e4-b9c3-9b69b428e9ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:29:29.100862 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06cb45e-2cd4-41e4-b9c3-9b69b428e9ad None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:29:29.101153 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06cb45e-2cd4-41e4-b9c3-9b69b428e9ad None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:29:29.101434 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06cb45e-2cd4-41e4-b9c3-9b69b428e9ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:29:29.112381 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06cb45e-2cd4-41e4-b9c3-9b69b428e9ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:29:29.113906 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06cb45e-2cd4-41e4-b9c3-9b69b428e9ad None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:29:29.131896 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application [None req-d06cb45e-2cd4-41e4-b9c3-9b69b428e9ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 08:29:29.131896 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:29:29.131896 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:29:29.131896 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:29:29.131896 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:29:29.131896 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:29:29.131896 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:29:29.131896 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:29:29.131896 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:29:29.131896 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:29:29.131896 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:29:29.131896 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:29:29.131896 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 08:29:29.131896 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 08:29:29.131896 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 08:29:29.133027 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 08:29:29.133027 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:29:29.133027 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:29:29.133027 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:29:29.133027 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:29:29.133027 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:29:29.133027 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:29:29.133027 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:29:29.133027 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application with Lock( May 27 08:29:29.133027 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:29:29.133027 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._enter() May 27 08:29:29.133027 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:29:29.133027 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:29:29.133027 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:29:29.133027 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.creator() May 27 08:29:29.133027 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:29:29.133027 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application created_value = creator( May 27 08:29:29.134105 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 08:29:29.134105 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 08:29:29.134105 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 08:29:29.134105 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application May 27 08:29:29.134105 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 438/877] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 08:29:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 08:29:29.139305 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba30e92-01ed-40c4-86b0-70506b1e8b0e None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:29:29.231080 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:29:29.245511 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba30e92-01ed-40c4-86b0-70506b1e8b0e None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:29:29.287534 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbc0ccf-d877-40cd-81ae-ac5539f06919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:29:29.288314 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbc0ccf-d877-40cd-81ae-ac5539f06919 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:29:29.288688 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbc0ccf-d877-40cd-81ae-ac5539f06919 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:29:29.288925 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbc0ccf-d877-40cd-81ae-ac5539f06919 None admin] PATH_INFO: `/v3/domains` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:29:29.289752 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbc0ccf-d877-40cd-81ae-ac5539f06919 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:29:29.290088 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbc0ccf-d877-40cd-81ae-ac5539f06919 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:29:29.292324 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbc0ccf-d877-40cd-81ae-ac5539f06919 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:29:29.307021 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 440/878] 10.222.0.62 () {56 vars in 1109 bytes} [Fri May 27 08:29:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:29:29.312521 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06cb45e-2cd4-41e4-b9c3-9b69b428e9ad None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:29:29.410857 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06cb45e-2cd4-41e4-b9c3-9b69b428e9ad None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:29:29.444366 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240008ff-35f4-4166-8ee1-e2ee67757ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:29:29.445170 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240008ff-35f4-4166-8ee1-e2ee67757ad3 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:29:29.445451 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240008ff-35f4-4166-8ee1-e2ee67757ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:29:29.445725 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240008ff-35f4-4166-8ee1-e2ee67757ad3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:29:29.453216 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240008ff-35f4-4166-8ee1-e2ee67757ad3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:29:29.454654 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240008ff-35f4-4166-8ee1-e2ee67757ad3 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:29:29.468784 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application [None req-240008ff-35f4-4166-8ee1-e2ee67757ad3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 08:29:29.468784 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:29:29.468784 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:29:29.468784 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:29:29.468784 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:29:29.468784 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:29:29.468784 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:29:29.468784 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:29:29.468784 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:29:29.468784 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:29:29.468784 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:29:29.468784 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:29:29.468784 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 08:29:29.468784 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 08:29:29.468784 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 08:29:29.469795 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 08:29:29.469795 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:29:29.469795 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:29:29.469795 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:29:29.469795 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:29:29.469795 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:29:29.469795 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:29:29.469795 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:29:29.469795 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application with Lock( May 27 08:29:29.469795 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:29:29.469795 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._enter() May 27 08:29:29.469795 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:29:29.469795 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:29:29.469795 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:29:29.469795 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.creator() May 27 08:29:29.469795 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:29:29.469795 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application created_value = creator( May 27 08:29:29.470733 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 08:29:29.470733 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 08:29:29.470733 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 08:29:29.470733 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 08:29:29.470733 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 08:29:29.470733 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 08:29:29.470733 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 08:29:29.470733 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application May 27 08:29:29.470733 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 439/879] 10.222.0.62 () {56 vars in 1111 bytes} [Fri May 27 08:29:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 08:29:29.475725 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbc0ccf-d877-40cd-81ae-ac5539f06919 None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:29:29.580405 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbc0ccf-d877-40cd-81ae-ac5539f06919 None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:29:29.614789 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da378b13-fe08-42e9-97db-a1282dc94b8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:29:29.615444 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da378b13-fe08-42e9-97db-a1282dc94b8a None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:29:29.615731 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da378b13-fe08-42e9-97db-a1282dc94b8a None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:29:29.616012 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da378b13-fe08-42e9-97db-a1282dc94b8a None admin] PATH_INFO: `/v3/projects` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:29:29.616891 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da378b13-fe08-42e9-97db-a1282dc94b8a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:29:29.617207 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da378b13-fe08-42e9-97db-a1282dc94b8a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:29:29.618871 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da378b13-fe08-42e9-97db-a1282dc94b8a None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:29:29.630821 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 441/880] 10.222.0.62 () {56 vars in 1148 bytes} [Fri May 27 08:29:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:29:29.637446 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240008ff-35f4-4166-8ee1-e2ee67757ad3 None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:29:29.660520 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:29:29.737342 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240008ff-35f4-4166-8ee1-e2ee67757ad3 None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:29:29.770644 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f9a752-587f-4285-8b91-714a8510794f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:29:29.771284 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f9a752-587f-4285-8b91-714a8510794f None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:29:29.771569 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f9a752-587f-4285-8b91-714a8510794f None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:29:29.771848 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f9a752-587f-4285-8b91-714a8510794f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:29:29.772759 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f9a752-587f-4285-8b91-714a8510794f None admin] RBAC: Adding query filter params (role.id=5e6f243a7201412c965e7c70249d4dc0, scope.project.id=256f4731060449f1b80067e51e8bec00, user.id=7b12a598052a4b749edb0c021d99b951) {{(pid=87172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:29:29.773060 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f9a752-587f-4285-8b91-714a8510794f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:29:29.774497 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f9a752-587f-4285-8b91-714a8510794f None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:29:29.780709 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 440/881] 10.222.0.62 () {56 vars in 1374 bytes} [Fri May 27 08:29:29 2022] GET /identity/v3/role_assignments?user.id=7b12a598052a4b749edb0c021d99b951&scope.project.id=256f4731060449f1b80067e51e8bec00&role.id=5e6f243a7201412c965e7c70249d4dc0 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:29:32.093880 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a507720-8b2a-42c8-beee-2dbe38654819 None None] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:29:32.094434 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a507720-8b2a-42c8-beee-2dbe38654819 None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:29:32.094434 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a507720-8b2a-42c8-beee-2dbe38654819 None None] PATH_INFO: `/` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:29:32.095827 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 442/882] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:29:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:29:32.101330 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef70fd9-5eac-469a-8961-63aaa781dda5 None None] REQUEST_METHOD: `POST` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:29:32.101806 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef70fd9-5eac-469a-8961-63aaa781dda5 None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:29:32.101899 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef70fd9-5eac-469a-8961-63aaa781dda5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:29:32.119321 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.auth.core [None req-bef70fd9-5eac-469a-8961-63aaa781dda5 None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:29:32.120672 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.fernet_utils [None req-bef70fd9-5eac-469a-8961-63aaa781dda5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:29:32.190559 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 441/883] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:29:32 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 08:29:32.215107 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a507720-8b2a-42c8-beee-2dbe38654819 None None] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:29:32.226037 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:29:32.330432 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a507720-8b2a-42c8-beee-2dbe38654819 None None] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:29:32.364256 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53a79a2-ec8f-4c9f-b62c-8e338892317c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:29:32.364996 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53a79a2-ec8f-4c9f-b62c-8e338892317c None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:29:32.365284 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53a79a2-ec8f-4c9f-b62c-8e338892317c None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:29:32.365562 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53a79a2-ec8f-4c9f-b62c-8e338892317c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:29:32.376511 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53a79a2-ec8f-4c9f-b62c-8e338892317c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 08:29:32.384807 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application [None req-c53a79a2-ec8f-4c9f-b62c-8e338892317c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 08:29:32.384807 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:29:32.384807 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:29:32.384807 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:29:32.384807 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:29:32.384807 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:29:32.384807 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:29:32.384807 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:29:32.384807 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:29:32.384807 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:29:32.384807 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:29:32.384807 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:29:32.384807 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 08:29:32.384807 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 08:29:32.384807 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 08:29:32.384807 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 08:29:32.385953 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 08:29:32.385953 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 08:29:32.385953 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 08:29:32.385953 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 08:29:32.385953 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:29:32.385953 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:29:32.385953 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:29:32.385953 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:29:32.385953 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:29:32.385953 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:29:32.385953 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:29:32.385953 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application with Lock( May 27 08:29:32.385953 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:29:32.385953 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._enter() May 27 08:29:32.385953 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:29:32.385953 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:29:32.386854 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:29:32.386854 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.creator() May 27 08:29:32.386854 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:29:32.386854 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application created_value = creator( May 27 08:29:32.386854 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 08:29:32.386854 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 08:29:32.386854 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 08:29:32.386854 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 08:29:32.386854 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 08:29:32.386854 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 08:29:32.386854 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 08:29:32.386854 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application May 27 08:29:32.386854 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 443/884] 10.222.0.62 () {56 vars in 1096 bytes} [Fri May 27 08:29:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 08:29:32.392039 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef70fd9-5eac-469a-8961-63aaa781dda5 None None] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:29:32.407523 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:29:32.495180 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef70fd9-5eac-469a-8961-63aaa781dda5 None None] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:29:32.529592 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c38cee8-7665-45b5-ad40-74b36edf038e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:29:32.530263 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c38cee8-7665-45b5-ad40-74b36edf038e None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:29:32.530547 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c38cee8-7665-45b5-ad40-74b36edf038e None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:29:32.530822 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c38cee8-7665-45b5-ad40-74b36edf038e None admin] PATH_INFO: `/v3/roles` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:29:32.531575 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c38cee8-7665-45b5-ad40-74b36edf038e None admin] RBAC: Adding query filter params (name=admin) {{(pid=87172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:29:32.531883 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c38cee8-7665-45b5-ad40-74b36edf038e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:29:32.533556 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c38cee8-7665-45b5-ad40-74b36edf038e None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:29:32.542539 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 442/885] 10.222.0.62 () {56 vars in 1099 bytes} [Fri May 27 08:29:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:29:32.549810 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53a79a2-ec8f-4c9f-b62c-8e338892317c None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:29:32.617057 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:29:32.653379 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53a79a2-ec8f-4c9f-b62c-8e338892317c None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:29:32.688214 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78d73d3-0bee-4d55-be4c-f792e6f15f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:29:32.689027 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78d73d3-0bee-4d55-be4c-f792e6f15f8c None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:29:32.689315 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78d73d3-0bee-4d55-be4c-f792e6f15f8c None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:29:32.689598 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78d73d3-0bee-4d55-be4c-f792e6f15f8c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:29:32.700165 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78d73d3-0bee-4d55-be4c-f792e6f15f8c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:29:32.701660 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78d73d3-0bee-4d55-be4c-f792e6f15f8c None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:29:32.718865 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application [None req-c78d73d3-0bee-4d55-be4c-f792e6f15f8c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 08:29:32.718865 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:29:32.718865 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:29:32.718865 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:29:32.718865 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:29:32.718865 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:29:32.718865 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:29:32.718865 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:29:32.718865 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:29:32.718865 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:29:32.718865 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:29:32.718865 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:29:32.718865 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 08:29:32.718865 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 08:29:32.718865 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 08:29:32.719787 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 08:29:32.719787 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:29:32.719787 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:29:32.719787 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:29:32.719787 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:29:32.719787 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:29:32.719787 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:29:32.719787 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:29:32.719787 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application with Lock( May 27 08:29:32.719787 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:29:32.719787 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._enter() May 27 08:29:32.719787 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:29:32.719787 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:29:32.719787 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:29:32.719787 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.creator() May 27 08:29:32.719787 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:29:32.719787 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application created_value = creator( May 27 08:29:32.720960 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 08:29:32.720960 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 08:29:32.720960 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 08:29:32.720960 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application May 27 08:29:32.720960 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 444/886] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 08:29:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 08:29:32.725850 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c38cee8-7665-45b5-ad40-74b36edf038e None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:29:32.803101 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:29:32.826923 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c38cee8-7665-45b5-ad40-74b36edf038e None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:29:32.860922 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f6ed17-4a96-4497-bc5f-600455460619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:29:32.861595 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f6ed17-4a96-4497-bc5f-600455460619 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:29:32.861884 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f6ed17-4a96-4497-bc5f-600455460619 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:29:32.862168 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f6ed17-4a96-4497-bc5f-600455460619 None admin] PATH_INFO: `/v3/domains` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:29:32.862907 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f6ed17-4a96-4497-bc5f-600455460619 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:29:32.863217 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f6ed17-4a96-4497-bc5f-600455460619 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:29:32.864657 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f6ed17-4a96-4497-bc5f-600455460619 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:29:32.877910 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 443/887] 10.222.0.62 () {56 vars in 1109 bytes} [Fri May 27 08:29:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:29:32.883485 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78d73d3-0bee-4d55-be4c-f792e6f15f8c None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:29:32.984121 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78d73d3-0bee-4d55-be4c-f792e6f15f8c None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:29:33.003600 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:29:33.017614 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccbb5ed-076d-42bb-ad16-d2d0932c2148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:29:33.018411 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccbb5ed-076d-42bb-ad16-d2d0932c2148 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:29:33.018689 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccbb5ed-076d-42bb-ad16-d2d0932c2148 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:29:33.018964 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccbb5ed-076d-42bb-ad16-d2d0932c2148 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:29:33.027014 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccbb5ed-076d-42bb-ad16-d2d0932c2148 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:29:33.028456 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccbb5ed-076d-42bb-ad16-d2d0932c2148 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:29:33.043656 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application [None req-3ccbb5ed-076d-42bb-ad16-d2d0932c2148 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 27 08:29:33.043656 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:29:33.043656 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:29:33.043656 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:29:33.043656 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:29:33.043656 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:29:33.043656 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:29:33.043656 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:29:33.043656 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:29:33.043656 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:29:33.043656 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:29:33.043656 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:29:33.043656 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 08:29:33.043656 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 08:29:33.043656 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 08:29:33.043656 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 08:29:33.044817 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:29:33.044817 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:29:33.044817 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 08:29:33.044817 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 08:29:33.044817 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 08:29:33.044817 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 08:29:33.044817 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:29:33.044817 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:29:33.044817 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:29:33.044817 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:29:33.044817 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:29:33.044817 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application with Lock( May 27 08:29:33.044817 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:29:33.044817 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._enter() May 27 08:29:33.044817 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:29:33.044817 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:29:33.044817 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:29:33.044817 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.creator() May 27 08:29:33.046178 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:29:33.046178 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application created_value = creator( May 27 08:29:33.046178 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 08:29:33.046178 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 08:29:33.046178 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 08:29:33.046178 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 08:29:33.046178 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 08:29:33.046178 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 08:29:33.046178 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 27 08:29:33.046178 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application May 27 08:29:33.046178 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 445/888] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 08:29:32 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 08:29:33.050655 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f6ed17-4a96-4497-bc5f-600455460619 None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:29:33.147436 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f6ed17-4a96-4497-bc5f-600455460619 None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:29:33.181862 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39841447-2a89-489c-86c5-5091f7d750d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:29:33.182524 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39841447-2a89-489c-86c5-5091f7d750d1 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:29:33.182811 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39841447-2a89-489c-86c5-5091f7d750d1 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:29:33.183092 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39841447-2a89-489c-86c5-5091f7d750d1 None admin] PATH_INFO: `/v3/users` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:29:33.183922 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39841447-2a89-489c-86c5-5091f7d750d1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:29:33.184234 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39841447-2a89-489c-86c5-5091f7d750d1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:29:33.185697 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39841447-2a89-489c-86c5-5091f7d750d1 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:29:33.188184 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:29:33.203672 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 444/889] 10.222.0.62 () {56 vars in 1143 bytes} [Fri May 27 08:29:33 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:29:33.209452 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccbb5ed-076d-42bb-ad16-d2d0932c2148 None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:29:33.325694 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccbb5ed-076d-42bb-ad16-d2d0932c2148 None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:29:33.359001 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43d28bc-0f96-4160-b01e-27e415c70112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:29:33.359789 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43d28bc-0f96-4160-b01e-27e415c70112 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:29:33.360076 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43d28bc-0f96-4160-b01e-27e415c70112 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:29:33.360362 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43d28bc-0f96-4160-b01e-27e415c70112 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:29:33.370997 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43d28bc-0f96-4160-b01e-27e415c70112 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:29:33.372454 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43d28bc-0f96-4160-b01e-27e415c70112 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:29:33.389980 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application [None req-f43d28bc-0f96-4160-b01e-27e415c70112 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 08:29:33.389980 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:29:33.389980 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:29:33.389980 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:29:33.389980 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:29:33.389980 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:29:33.389980 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:29:33.389980 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:29:33.389980 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:29:33.389980 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:29:33.389980 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:29:33.389980 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:29:33.389980 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 08:29:33.389980 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 08:29:33.389980 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 08:29:33.391037 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 08:29:33.391037 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:29:33.391037 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:29:33.391037 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:29:33.391037 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:29:33.391037 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:29:33.391037 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:29:33.391037 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:29:33.391037 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application with Lock( May 27 08:29:33.391037 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:29:33.391037 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._enter() May 27 08:29:33.391037 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:29:33.391037 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:29:33.391037 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:29:33.391037 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.creator() May 27 08:29:33.391037 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:29:33.391037 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application created_value = creator( May 27 08:29:33.392141 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 08:29:33.392141 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 08:29:33.392141 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 08:29:33.392141 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application May 27 08:29:33.392141 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 446/890] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 08:29:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 08:29:33.396905 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39841447-2a89-489c-86c5-5091f7d750d1 None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:29:33.493967 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39841447-2a89-489c-86c5-5091f7d750d1 None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:29:33.529059 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6434c2ba-3c48-48dc-8a61-c275b0e01f1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:29:33.529725 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6434c2ba-3c48-48dc-8a61-c275b0e01f1b None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:29:33.530051 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6434c2ba-3c48-48dc-8a61-c275b0e01f1b None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:29:33.530332 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6434c2ba-3c48-48dc-8a61-c275b0e01f1b None admin] PATH_INFO: `/v3/domains` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:29:33.531115 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6434c2ba-3c48-48dc-8a61-c275b0e01f1b None admin] RBAC: Adding query filter params (name=Default) {{(pid=87172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:29:33.531424 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6434c2ba-3c48-48dc-8a61-c275b0e01f1b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:29:33.532837 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6434c2ba-3c48-48dc-8a61-c275b0e01f1b None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:29:33.545050 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 445/891] 10.222.0.62 () {56 vars in 1109 bytes} [Fri May 27 08:29:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:29:33.550828 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43d28bc-0f96-4160-b01e-27e415c70112 None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:29:33.582839 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:29:33.671760 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43d28bc-0f96-4160-b01e-27e415c70112 None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:29:33.706917 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028580eb-943d-4e14-9d3e-814341ce16fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:29:33.707716 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028580eb-943d-4e14-9d3e-814341ce16fa None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:29:33.708002 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028580eb-943d-4e14-9d3e-814341ce16fa None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:29:33.708279 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028580eb-943d-4e14-9d3e-814341ce16fa None admin] PATH_INFO: `/v3/projects/service` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:29:33.715308 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028580eb-943d-4e14-9d3e-814341ce16fa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:29:33.716788 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028580eb-943d-4e14-9d3e-814341ce16fa None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:29:33.730922 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application [None req-028580eb-943d-4e14-9d3e-814341ce16fa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 08:29:33.730922 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:29:33.730922 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:29:33.730922 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:29:33.730922 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:29:33.730922 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:29:33.730922 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:29:33.730922 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:29:33.730922 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:29:33.730922 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:29:33.730922 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:29:33.730922 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:29:33.730922 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 08:29:33.730922 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 08:29:33.730922 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 08:29:33.731999 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 08:29:33.731999 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:29:33.731999 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:29:33.731999 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:29:33.731999 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:29:33.731999 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:29:33.731999 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:29:33.731999 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:29:33.731999 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application with Lock( May 27 08:29:33.731999 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:29:33.731999 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._enter() May 27 08:29:33.731999 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:29:33.731999 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:29:33.731999 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:29:33.731999 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.creator() May 27 08:29:33.731999 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:29:33.731999 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application created_value = creator( May 27 08:29:33.733158 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 08:29:33.733158 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 08:29:33.733158 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 08:29:33.733158 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 08:29:33.733158 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 08:29:33.733158 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 08:29:33.733158 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 08:29:33.733158 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application May 27 08:29:33.733158 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 447/892] 10.222.0.62 () {56 vars in 1111 bytes} [Fri May 27 08:29:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 08:29:33.737788 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6434c2ba-3c48-48dc-8a61-c275b0e01f1b None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:29:33.793698 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:29:33.845262 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6434c2ba-3c48-48dc-8a61-c275b0e01f1b None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:29:33.880996 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbb82fc-b630-4d7d-b388-fa9cbd895dcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:29:33.881656 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbb82fc-b630-4d7d-b388-fa9cbd895dcd None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:29:33.881944 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbb82fc-b630-4d7d-b388-fa9cbd895dcd None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:29:33.882224 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbb82fc-b630-4d7d-b388-fa9cbd895dcd None admin] PATH_INFO: `/v3/projects` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:29:33.883017 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbb82fc-b630-4d7d-b388-fa9cbd895dcd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:29:33.883330 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbb82fc-b630-4d7d-b388-fa9cbd895dcd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:29:33.885415 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbb82fc-b630-4d7d-b388-fa9cbd895dcd None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:29:33.897485 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 446/893] 10.222.0.62 () {56 vars in 1148 bytes} [Fri May 27 08:29:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:29:33.903429 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028580eb-943d-4e14-9d3e-814341ce16fa None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:29:34.013492 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:29:34.022488 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028580eb-943d-4e14-9d3e-814341ce16fa None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:29:34.058085 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5092009-a405-4e5e-88bc-a7238b8ea501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:29:34.058969 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5092009-a405-4e5e-88bc-a7238b8ea501 None admin] REQUEST_METHOD: `PUT` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:29:34.059250 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5092009-a405-4e5e-88bc-a7238b8ea501 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:29:34.059528 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5092009-a405-4e5e-88bc-a7238b8ea501 None admin] PATH_INFO: `/v3/projects/256f4731060449f1b80067e51e8bec00/users/7b12a598052a4b749edb0c021d99b951/roles/5e6f243a7201412c965e7c70249d4dc0` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:29:34.061518 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5092009-a405-4e5e-88bc-a7238b8ea501 None admin] RBAC: Authorizing `identity:create_grant(project_id=256f4731060449f1b80067e51e8bec00, user_id=7b12a598052a4b749edb0c021d99b951, role_id=5e6f243a7201412c965e7c70249d4dc0)` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:29:34.062986 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5092009-a405-4e5e-88bc-a7238b8ea501 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:29:34.075874 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 448/894] 10.222.0.62 () {58 vars in 1439 bytes} [Fri May 27 08:29:33 2022] PUT /identity/v3/projects/256f4731060449f1b80067e51e8bec00/users/7b12a598052a4b749edb0c021d99b951/roles/5e6f243a7201412c965e7c70249d4dc0 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 08:29:36.353425 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1300e6ed-e01a-4359-8291-df6ef1f844ca None None] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:29:36.353957 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1300e6ed-e01a-4359-8291-df6ef1f844ca None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:29:36.353957 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1300e6ed-e01a-4359-8291-df6ef1f844ca None None] PATH_INFO: `/` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:29:36.355338 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 447/895] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:29:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:29:36.360646 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fec897e-5125-412a-a147-ec81e6e3f45e None None] REQUEST_METHOD: `POST` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:29:36.361084 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fec897e-5125-412a-a147-ec81e6e3f45e None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:29:36.361219 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fec897e-5125-412a-a147-ec81e6e3f45e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:29:36.378304 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.auth.core [None req-7fec897e-5125-412a-a147-ec81e6e3f45e None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:29:36.379516 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.fernet_utils [None req-7fec897e-5125-412a-a147-ec81e6e3f45e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:29:36.448185 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 449/896] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:29:36 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 08:29:36.473948 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1300e6ed-e01a-4359-8291-df6ef1f844ca None None] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:29:36.575674 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1300e6ed-e01a-4359-8291-df6ef1f844ca None None] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:29:36.590114 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:29:36.610479 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dc3745-b19e-46ac-ae34-dcbc801dea5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:29:36.611190 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dc3745-b19e-46ac-ae34-dcbc801dea5a None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:29:36.611475 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dc3745-b19e-46ac-ae34-dcbc801dea5a None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:29:36.611753 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dc3745-b19e-46ac-ae34-dcbc801dea5a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:29:36.621815 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dc3745-b19e-46ac-ae34-dcbc801dea5a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 27 08:29:36.629328 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application [None req-72dc3745-b19e-46ac-ae34-dcbc801dea5a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 27 08:29:36.629328 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:29:36.629328 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:29:36.629328 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:29:36.629328 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:29:36.629328 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:29:36.629328 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:29:36.629328 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:29:36.629328 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:29:36.629328 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:29:36.629328 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:29:36.629328 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:29:36.629328 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 27 08:29:36.629328 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._get_role(role_id) May 27 08:29:36.629328 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 27 08:29:36.629328 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 27 08:29:36.630624 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 27 08:29:36.630624 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 27 08:29:36.630624 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 27 08:29:36.630624 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 27 08:29:36.630624 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:29:36.630624 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:29:36.630624 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:29:36.630624 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:29:36.630624 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:29:36.630624 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:29:36.630624 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:29:36.630624 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application with Lock( May 27 08:29:36.630624 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:29:36.630624 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._enter() May 27 08:29:36.630624 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:29:36.630624 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:29:36.631464 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:29:36.631464 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.creator() May 27 08:29:36.631464 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:29:36.631464 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application created_value = creator( May 27 08:29:36.631464 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 27 08:29:36.631464 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 27 08:29:36.631464 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 27 08:29:36.631464 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 27 08:29:36.631464 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 27 08:29:36.631464 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 27 08:29:36.631464 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 27 08:29:36.631464 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application May 27 08:29:36.631464 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 448/897] 10.222.0.62 () {56 vars in 1096 bytes} [Fri May 27 08:29:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 08:29:36.636922 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fec897e-5125-412a-a147-ec81e6e3f45e None None] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:29:36.717227 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:29:36.736741 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fec897e-5125-412a-a147-ec81e6e3f45e None None] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:29:36.769371 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bf3ae0-d5ba-466e-bdc5-2cc60a9158ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:29:36.770030 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bf3ae0-d5ba-466e-bdc5-2cc60a9158ae None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:29:36.770314 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bf3ae0-d5ba-466e-bdc5-2cc60a9158ae None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:29:36.770593 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bf3ae0-d5ba-466e-bdc5-2cc60a9158ae None admin] PATH_INFO: `/v3/roles` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:29:36.771337 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bf3ae0-d5ba-466e-bdc5-2cc60a9158ae None admin] RBAC: Adding query filter params (name=admin) {{(pid=87173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:29:36.771638 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bf3ae0-d5ba-466e-bdc5-2cc60a9158ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:29:36.773042 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bf3ae0-d5ba-466e-bdc5-2cc60a9158ae None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:29:36.781671 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 450/898] 10.222.0.62 () {56 vars in 1099 bytes} [Fri May 27 08:29:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:29:36.787590 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dc3745-b19e-46ac-ae34-dcbc801dea5a None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:29:36.888356 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dc3745-b19e-46ac-ae34-dcbc801dea5a None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:29:36.922146 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba3d96b-1556-497d-9594-5ea81ed4583f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:29:36.922980 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba3d96b-1556-497d-9594-5ea81ed4583f None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:29:36.923267 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba3d96b-1556-497d-9594-5ea81ed4583f None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:29:36.923557 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba3d96b-1556-497d-9594-5ea81ed4583f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:29:36.934543 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba3d96b-1556-497d-9594-5ea81ed4583f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:29:36.935998 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba3d96b-1556-497d-9594-5ea81ed4583f None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:29:36.953265 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application [None req-6ba3d96b-1556-497d-9594-5ea81ed4583f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 08:29:36.953265 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:29:36.953265 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:29:36.953265 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:29:36.953265 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:29:36.953265 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:29:36.953265 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:29:36.953265 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:29:36.953265 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:29:36.953265 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:29:36.953265 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:29:36.953265 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:29:36.953265 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 08:29:36.953265 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 08:29:36.953265 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 08:29:36.954334 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 08:29:36.954334 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:29:36.954334 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:29:36.954334 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:29:36.954334 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:29:36.954334 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:29:36.954334 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:29:36.954334 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:29:36.954334 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application with Lock( May 27 08:29:36.954334 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:29:36.954334 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._enter() May 27 08:29:36.954334 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:29:36.954334 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:29:36.954334 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:29:36.954334 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.creator() May 27 08:29:36.954334 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:29:36.954334 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application created_value = creator( May 27 08:29:36.955345 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 08:29:36.955345 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 08:29:36.955345 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 08:29:36.955345 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application May 27 08:29:36.955345 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 449/899] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 08:29:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 08:29:36.960231 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bf3ae0-d5ba-466e-bdc5-2cc60a9158ae None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:29:37.060017 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bf3ae0-d5ba-466e-bdc5-2cc60a9158ae None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:29:37.093599 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef6babf-b055-4972-a557-6c143bfad641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:29:37.094259 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef6babf-b055-4972-a557-6c143bfad641 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:29:37.094546 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef6babf-b055-4972-a557-6c143bfad641 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:29:37.094833 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef6babf-b055-4972-a557-6c143bfad641 None admin] PATH_INFO: `/v3/domains` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:29:37.095563 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef6babf-b055-4972-a557-6c143bfad641 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:29:37.095868 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef6babf-b055-4972-a557-6c143bfad641 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:29:37.097328 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef6babf-b055-4972-a557-6c143bfad641 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:29:37.109962 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 451/900] 10.222.0.62 () {56 vars in 1109 bytes} [Fri May 27 08:29:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:29:37.115745 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba3d96b-1556-497d-9594-5ea81ed4583f None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:29:37.144872 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:29:37.219159 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba3d96b-1556-497d-9594-5ea81ed4583f None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:29:37.254924 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85076162-4afa-4e2c-a04e-ace57524a5dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:29:37.255690 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85076162-4afa-4e2c-a04e-ace57524a5dd None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:29:37.256025 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85076162-4afa-4e2c-a04e-ace57524a5dd None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:29:37.256315 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85076162-4afa-4e2c-a04e-ace57524a5dd None admin] PATH_INFO: `/v3/users/placement` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:29:37.265852 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85076162-4afa-4e2c-a04e-ace57524a5dd None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:29:37.267560 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85076162-4afa-4e2c-a04e-ace57524a5dd None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:29:37.285052 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application [None req-85076162-4afa-4e2c-a04e-ace57524a5dd None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 27 08:29:37.285052 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:29:37.285052 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:29:37.285052 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:29:37.285052 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:29:37.285052 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:29:37.285052 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:29:37.285052 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:29:37.285052 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:29:37.285052 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:29:37.285052 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:29:37.285052 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:29:37.285052 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 27 08:29:37.285052 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._get_user(user_id) May 27 08:29:37.285052 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 27 08:29:37.285052 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 27 08:29:37.286284 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:29:37.286284 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:29:37.286284 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 27 08:29:37.286284 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 08:29:37.286284 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 27 08:29:37.286284 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 27 08:29:37.286284 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:29:37.286284 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:29:37.286284 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:29:37.286284 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:29:37.286284 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:29:37.286284 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application with Lock( May 27 08:29:37.286284 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:29:37.286284 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._enter() May 27 08:29:37.286284 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:29:37.286284 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:29:37.286284 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:29:37.286284 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.creator() May 27 08:29:37.287423 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:29:37.287423 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application created_value = creator( May 27 08:29:37.287423 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 27 08:29:37.287423 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 27 08:29:37.287423 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 27 08:29:37.287423 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 27 08:29:37.287423 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 27 08:29:37.287423 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 27 08:29:37.287423 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 27 08:29:37.287423 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application May 27 08:29:37.287423 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 450/901] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 08:29:37 2022] GET /identity/v3/users/placement => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 08:29:37.293240 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef6babf-b055-4972-a557-6c143bfad641 None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:29:37.297394 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:29:37.399064 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef6babf-b055-4972-a557-6c143bfad641 None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:29:37.434018 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5197e809-0f8b-4a16-9048-9bc8c2017aaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:29:37.434687 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5197e809-0f8b-4a16-9048-9bc8c2017aaa None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:29:37.434972 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5197e809-0f8b-4a16-9048-9bc8c2017aaa None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:29:37.435248 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5197e809-0f8b-4a16-9048-9bc8c2017aaa None admin] PATH_INFO: `/v3/users` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:29:37.436086 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5197e809-0f8b-4a16-9048-9bc8c2017aaa None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:29:37.436391 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5197e809-0f8b-4a16-9048-9bc8c2017aaa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:29:37.437880 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5197e809-0f8b-4a16-9048-9bc8c2017aaa None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:29:37.455176 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 452/902] 10.222.0.62 () {56 vars in 1143 bytes} [Fri May 27 08:29:37 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:29:37.460961 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85076162-4afa-4e2c-a04e-ace57524a5dd None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:29:37.550118 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:29:37.565662 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85076162-4afa-4e2c-a04e-ace57524a5dd None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:29:37.598658 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af660f95-e55f-49c0-958a-99fa11a122d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:29:37.599295 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af660f95-e55f-49c0-958a-99fa11a122d4 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:29:37.599580 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af660f95-e55f-49c0-958a-99fa11a122d4 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:29:37.599856 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af660f95-e55f-49c0-958a-99fa11a122d4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:29:37.668729 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af660f95-e55f-49c0-958a-99fa11a122d4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:29:37.670104 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af660f95-e55f-49c0-958a-99fa11a122d4 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:29:37.751899 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:29:37.768010 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 451/903] 10.222.0.62 () {58 vars in 1282 bytes} [Fri May 27 08:29:37 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 27 08:29:37.773735 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5197e809-0f8b-4a16-9048-9bc8c2017aaa None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:29:37.835813 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:29:37.875277 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5197e809-0f8b-4a16-9048-9bc8c2017aaa None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:29:37.913144 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60af4ff7-dbfc-4152-87b9-2edbd65d4f10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:29:37.913927 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60af4ff7-dbfc-4152-87b9-2edbd65d4f10 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:29:37.914207 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60af4ff7-dbfc-4152-87b9-2edbd65d4f10 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:29:37.914480 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60af4ff7-dbfc-4152-87b9-2edbd65d4f10 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:29:37.924658 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60af4ff7-dbfc-4152-87b9-2edbd65d4f10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:29:37.926060 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60af4ff7-dbfc-4152-87b9-2edbd65d4f10 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:29:37.943251 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application [None req-60af4ff7-dbfc-4152-87b9-2edbd65d4f10 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 27 08:29:37.943251 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:29:37.943251 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:29:37.943251 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:29:37.943251 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:29:37.943251 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:29:37.943251 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:29:37.943251 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:29:37.943251 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:29:37.943251 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:29:37.943251 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:29:37.943251 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:29:37.943251 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 27 08:29:37.943251 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 27 08:29:37.943251 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 27 08:29:37.944414 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 27 08:29:37.944414 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:29:37.944414 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:29:37.944414 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:29:37.944414 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:29:37.944414 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:29:37.944414 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:29:37.944414 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:29:37.944414 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application with Lock( May 27 08:29:37.944414 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:29:37.944414 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._enter() May 27 08:29:37.944414 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:29:37.944414 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:29:37.944414 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:29:37.944414 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.creator() May 27 08:29:37.944414 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:29:37.944414 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application created_value = creator( May 27 08:29:37.945582 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 27 08:29:37.945582 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 27 08:29:37.945582 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 27 08:29:37.945582 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application May 27 08:29:37.945582 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 453/904] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 08:29:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 08:29:37.950949 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af660f95-e55f-49c0-958a-99fa11a122d4 None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:29:38.050337 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af660f95-e55f-49c0-958a-99fa11a122d4 None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:29:38.084619 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cc9b65-034d-4c71-a19d-582eded82666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:29:38.085328 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cc9b65-034d-4c71-a19d-582eded82666 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:29:38.085614 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cc9b65-034d-4c71-a19d-582eded82666 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:29:38.085893 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cc9b65-034d-4c71-a19d-582eded82666 None admin] PATH_INFO: `/v3/domains` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:29:38.087211 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cc9b65-034d-4c71-a19d-582eded82666 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:29:38.087534 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cc9b65-034d-4c71-a19d-582eded82666 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:29:38.088941 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cc9b65-034d-4c71-a19d-582eded82666 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:29:38.099985 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 452/905] 10.222.0.62 () {56 vars in 1109 bytes} [Fri May 27 08:29:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:29:38.105682 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60af4ff7-dbfc-4152-87b9-2edbd65d4f10 None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:29:38.204130 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60af4ff7-dbfc-4152-87b9-2edbd65d4f10 None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:29:38.218833 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:29:38.239778 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9ffecd-d5c2-4a7e-b3e5-84fc263854bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:29:38.240570 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9ffecd-d5c2-4a7e-b3e5-84fc263854bb None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:29:38.241029 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9ffecd-d5c2-4a7e-b3e5-84fc263854bb None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:29:38.241311 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9ffecd-d5c2-4a7e-b3e5-84fc263854bb None admin] PATH_INFO: `/v3/projects/service` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:29:38.248510 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9ffecd-d5c2-4a7e-b3e5-84fc263854bb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:29:38.249993 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9ffecd-d5c2-4a7e-b3e5-84fc263854bb None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:29:38.266912 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application [None req-1f9ffecd-d5c2-4a7e-b3e5-84fc263854bb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 27 08:29:38.266912 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:29:38.266912 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:29:38.266912 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:29:38.266912 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:29:38.266912 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:29:38.266912 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:29:38.266912 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:29:38.266912 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:29:38.266912 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:29:38.266912 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:29:38.266912 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:29:38.266912 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 27 08:29:38.266912 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._get_project(project_id) May 27 08:29:38.266912 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 27 08:29:38.267858 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 27 08:29:38.267858 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:29:38.267858 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:29:38.267858 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:29:38.267858 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:29:38.267858 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:29:38.267858 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:29:38.267858 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:29:38.267858 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application with Lock( May 27 08:29:38.267858 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:29:38.267858 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._enter() May 27 08:29:38.267858 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:29:38.267858 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:29:38.267858 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:29:38.267858 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.creator() May 27 08:29:38.267858 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:29:38.267858 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application created_value = creator( May 27 08:29:38.268794 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 27 08:29:38.268794 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 27 08:29:38.268794 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 27 08:29:38.268794 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 27 08:29:38.268794 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 27 08:29:38.268794 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 27 08:29:38.268794 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 27 08:29:38.268794 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: ERROR keystone.server.flask.application May 27 08:29:38.268794 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 454/906] 10.222.0.62 () {56 vars in 1111 bytes} [Fri May 27 08:29:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 08:29:38.274322 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cc9b65-034d-4c71-a19d-582eded82666 None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:29:38.322439 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:29:38.376954 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cc9b65-034d-4c71-a19d-582eded82666 None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:29:38.411778 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01377a4-933c-4a80-a504-6e771e0193d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:29:38.412442 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01377a4-933c-4a80-a504-6e771e0193d2 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:29:38.412759 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01377a4-933c-4a80-a504-6e771e0193d2 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:29:38.413032 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01377a4-933c-4a80-a504-6e771e0193d2 None admin] PATH_INFO: `/v3/projects` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:29:38.413821 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01377a4-933c-4a80-a504-6e771e0193d2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:29:38.414126 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01377a4-933c-4a80-a504-6e771e0193d2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:29:38.415969 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01377a4-933c-4a80-a504-6e771e0193d2 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:29:38.428351 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 453/907] 10.222.0.62 () {56 vars in 1148 bytes} [Fri May 27 08:29:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:29:38.435118 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9ffecd-d5c2-4a7e-b3e5-84fc263854bb None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:29:38.537868 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9ffecd-d5c2-4a7e-b3e5-84fc263854bb None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:29:38.571290 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ebaf82-6bdd-4fed-b78b-7f0e473ebf5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:29:38.571926 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ebaf82-6bdd-4fed-b78b-7f0e473ebf5b None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:29:38.572207 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ebaf82-6bdd-4fed-b78b-7f0e473ebf5b None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:29:38.572483 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ebaf82-6bdd-4fed-b78b-7f0e473ebf5b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:29:38.573336 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ebaf82-6bdd-4fed-b78b-7f0e473ebf5b None admin] RBAC: Adding query filter params (role.id=5e6f243a7201412c965e7c70249d4dc0, scope.project.id=256f4731060449f1b80067e51e8bec00, user.id=7b12a598052a4b749edb0c021d99b951) {{(pid=87173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:29:38.573644 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ebaf82-6bdd-4fed-b78b-7f0e473ebf5b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:29:38.575079 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ebaf82-6bdd-4fed-b78b-7f0e473ebf5b None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:29:38.581195 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 455/908] 10.222.0.62 () {56 vars in 1374 bytes} [Fri May 27 08:29:38 2022] GET /identity/v3/role_assignments?user.id=7b12a598052a4b749edb0c021d99b951&scope.project.id=256f4731060449f1b80067e51e8bec00&role.id=5e6f243a7201412c965e7c70249d4dc0 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:29:40.887772 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681ea78b-04fe-49cd-8e79-53c606935e03 None None] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:29:40.888351 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681ea78b-04fe-49cd-8e79-53c606935e03 None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:29:40.888351 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681ea78b-04fe-49cd-8e79-53c606935e03 None None] PATH_INFO: `/` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:29:40.889741 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 454/909] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:29:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:29:40.895017 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4262f710-e2e0-44e3-8b87-4f6f9d8da054 None None] REQUEST_METHOD: `POST` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:29:40.895394 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4262f710-e2e0-44e3-8b87-4f6f9d8da054 None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:29:40.895526 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4262f710-e2e0-44e3-8b87-4f6f9d8da054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:29:40.912974 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.auth.core [None req-4262f710-e2e0-44e3-8b87-4f6f9d8da054 None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:29:40.914162 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.fernet_utils [None req-4262f710-e2e0-44e3-8b87-4f6f9d8da054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:29:40.943661 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:29:40.981903 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 456/910] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:29:40 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 08:29:41.004897 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681ea78b-04fe-49cd-8e79-53c606935e03 None None] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:29:41.106775 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681ea78b-04fe-49cd-8e79-53c606935e03 None None] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:29:41.114156 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:29:41.141784 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6314c388-b4ec-4c5f-ae04-7f03527d2f60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:29:41.142570 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6314c388-b4ec-4c5f-ae04-7f03527d2f60 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:29:41.142855 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6314c388-b4ec-4c5f-ae04-7f03527d2f60 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:29:41.143133 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6314c388-b4ec-4c5f-ae04-7f03527d2f60 None admin] PATH_INFO: `/v3/services/placement` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:29:41.143777 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6314c388-b4ec-4c5f-ae04-7f03527d2f60 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:29:41.145241 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6314c388-b4ec-4c5f-ae04-7f03527d2f60 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:29:41.157583 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application [None req-6314c388-b4ec-4c5f-ae04-7f03527d2f60 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 27 08:29:41.157583 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:29:41.157583 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 08:29:41.157583 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 08:29:41.157583 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 08:29:41.157583 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 08:29:41.157583 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 08:29:41.157583 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 08:29:41.157583 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 27 08:29:41.157583 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application May 27 08:29:41.157583 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 08:29:41.157583 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application May 27 08:29:41.157583 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:29:41.157583 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:29:41.157583 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:29:41.157583 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:29:41.157583 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:29:41.159110 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:29:41.159110 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:29:41.159110 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:29:41.159110 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:29:41.159110 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:29:41.159110 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:29:41.159110 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 08:29:41.159110 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 08:29:41.159110 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 08:29:41.159110 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 08:29:41.159110 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:29:41.159110 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:29:41.159110 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:29:41.159110 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:29:41.159110 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:29:41.159110 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:29:41.160159 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:29:41.160159 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application with Lock( May 27 08:29:41.160159 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:29:41.160159 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._enter() May 27 08:29:41.160159 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:29:41.160159 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:29:41.160159 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:29:41.160159 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.creator() May 27 08:29:41.160159 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:29:41.160159 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application created_value = creator( May 27 08:29:41.160159 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 08:29:41.160159 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 08:29:41.160159 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 27 08:29:41.160159 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application May 27 08:29:41.164781 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 455/911] 10.222.0.62 () {56 vars in 1117 bytes} [Fri May 27 08:29:41 2022] GET /identity/v3/services/placement => generated 90 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 27 08:29:41.166652 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4262f710-e2e0-44e3-8b87-4f6f9d8da054 None None] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:29:41.267641 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4262f710-e2e0-44e3-8b87-4f6f9d8da054 None None] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:29:41.309319 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec09da12-5649-4d3b-b7f6-7ef7f5598a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:29:41.310246 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec09da12-5649-4d3b-b7f6-7ef7f5598a8b None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:29:41.310582 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec09da12-5649-4d3b-b7f6-7ef7f5598a8b None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:29:41.310899 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec09da12-5649-4d3b-b7f6-7ef7f5598a8b None admin] PATH_INFO: `/v3/services` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:29:41.311787 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec09da12-5649-4d3b-b7f6-7ef7f5598a8b None admin] RBAC: Adding query filter params (name=placement) {{(pid=87173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:29:41.312128 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec09da12-5649-4d3b-b7f6-7ef7f5598a8b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:29:41.313786 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec09da12-5649-4d3b-b7f6-7ef7f5598a8b None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:29:41.319788 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 457/912] 10.222.0.62 () {56 vars in 1116 bytes} [Fri May 27 08:29:41 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:29:41.326565 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6314c388-b4ec-4c5f-ae04-7f03527d2f60 None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:29:41.429251 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6314c388-b4ec-4c5f-ae04-7f03527d2f60 None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:29:41.463289 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29286c92-d143-434d-95b9-58f20e7bb07b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:29:41.463946 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29286c92-d143-434d-95b9-58f20e7bb07b None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:29:41.464238 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29286c92-d143-434d-95b9-58f20e7bb07b None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:29:41.464519 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29286c92-d143-434d-95b9-58f20e7bb07b None admin] PATH_INFO: `/v3/services` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:29:41.465260 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29286c92-d143-434d-95b9-58f20e7bb07b None admin] RBAC: Adding query filter params (type=placement) {{(pid=87172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:29:41.465569 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29286c92-d143-434d-95b9-58f20e7bb07b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:29:41.466944 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29286c92-d143-434d-95b9-58f20e7bb07b None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:29:41.471378 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 456/913] 10.222.0.62 () {56 vars in 1116 bytes} [Fri May 27 08:29:41 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:29:43.746838 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7c1e88-fb82-4800-9369-8bca8bb5afa3 None None] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:29:43.747358 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7c1e88-fb82-4800-9369-8bca8bb5afa3 None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:29:43.747445 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7c1e88-fb82-4800-9369-8bca8bb5afa3 None None] PATH_INFO: `/` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:29:43.748833 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 458/914] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:29:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:29:43.754206 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2358e9-2795-4c84-b48c-118f0c98ae71 None None] REQUEST_METHOD: `POST` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:29:43.754644 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2358e9-2795-4c84-b48c-118f0c98ae71 None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:29:43.754769 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2358e9-2795-4c84-b48c-118f0c98ae71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:29:43.771721 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.auth.core [None req-3b2358e9-2795-4c84-b48c-118f0c98ae71 None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:29:43.772935 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.fernet_utils [None req-3b2358e9-2795-4c84-b48c-118f0c98ae71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:29:43.799741 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:29:43.840976 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 457/915] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:29:43 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 08:29:43.865603 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7c1e88-fb82-4800-9369-8bca8bb5afa3 None None] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:29:43.897843 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:29:43.969371 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7c1e88-fb82-4800-9369-8bca8bb5afa3 None None] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:29:44.004091 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08312621-351e-4dae-97aa-3c47a8b58a14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:29:44.004626 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08312621-351e-4dae-97aa-3c47a8b58a14 None admin] REQUEST_METHOD: `POST` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:29:44.004857 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08312621-351e-4dae-97aa-3c47a8b58a14 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:29:44.005136 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08312621-351e-4dae-97aa-3c47a8b58a14 None admin] PATH_INFO: `/v3/services` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:29:44.005849 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08312621-351e-4dae-97aa-3c47a8b58a14 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:29:44.007223 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08312621-351e-4dae-97aa-3c47a8b58a14 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:29:44.020906 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 459/916] 10.222.0.62 () {60 vars in 1141 bytes} [Fri May 27 08:29:43 2022] POST /identity/v3/services => generated 246 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 08:29:46.388457 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8272d3f4-99ca-43df-a5f0-c1c812d60f6e None None] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:29:46.389032 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8272d3f4-99ca-43df-a5f0-c1c812d60f6e None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:29:46.389032 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8272d3f4-99ca-43df-a5f0-c1c812d60f6e None None] PATH_INFO: `/` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:29:46.390430 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 458/917] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:29:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:29:46.395572 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cd79c6-9bf7-4134-8462-06011f3d4fc9 None None] REQUEST_METHOD: `POST` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:29:46.395989 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cd79c6-9bf7-4134-8462-06011f3d4fc9 None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:29:46.396126 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cd79c6-9bf7-4134-8462-06011f3d4fc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:29:46.413114 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.auth.core [None req-14cd79c6-9bf7-4134-8462-06011f3d4fc9 None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:29:46.414360 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.fernet_utils [None req-14cd79c6-9bf7-4134-8462-06011f3d4fc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:29:46.485415 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 460/918] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:29:46 2022] POST /identity/v3/auth/tokens => generated 1962 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 08:29:46.510233 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8272d3f4-99ca-43df-a5f0-c1c812d60f6e None None] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:29:46.616560 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8272d3f4-99ca-43df-a5f0-c1c812d60f6e None None] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:29:46.655146 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e998ba-3c9b-4a0e-839a-c1b1ecbaafd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:29:46.655960 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e998ba-3c9b-4a0e-839a-c1b1ecbaafd3 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:29:46.656246 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e998ba-3c9b-4a0e-839a-c1b1ecbaafd3 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:29:46.656525 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e998ba-3c9b-4a0e-839a-c1b1ecbaafd3 None admin] PATH_INFO: `/v3/services/placement` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:29:46.657223 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e998ba-3c9b-4a0e-839a-c1b1ecbaafd3 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:29:46.658887 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e998ba-3c9b-4a0e-839a-c1b1ecbaafd3 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:29:46.671419 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application [None req-55e998ba-3c9b-4a0e-839a-c1b1ecbaafd3 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 27 08:29:46.671419 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:29:46.671419 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 08:29:46.671419 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 08:29:46.671419 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 08:29:46.671419 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 08:29:46.671419 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 08:29:46.671419 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 08:29:46.671419 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 27 08:29:46.671419 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application May 27 08:29:46.671419 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 08:29:46.671419 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application May 27 08:29:46.671419 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:29:46.671419 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:29:46.671419 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:29:46.671419 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:29:46.671419 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:29:46.672935 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:29:46.672935 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:29:46.672935 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:29:46.672935 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:29:46.672935 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:29:46.672935 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:29:46.672935 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 08:29:46.672935 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 08:29:46.672935 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 08:29:46.672935 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 08:29:46.672935 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:29:46.672935 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:29:46.672935 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:29:46.672935 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:29:46.672935 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:29:46.672935 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:29:46.673785 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:29:46.673785 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application with Lock( May 27 08:29:46.673785 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:29:46.673785 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._enter() May 27 08:29:46.673785 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:29:46.673785 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:29:46.673785 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:29:46.673785 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.creator() May 27 08:29:46.673785 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:29:46.673785 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application created_value = creator( May 27 08:29:46.673785 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 08:29:46.673785 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 08:29:46.673785 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 27 08:29:46.673785 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application May 27 08:29:46.673785 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 459/919] 10.222.0.62 () {56 vars in 1117 bytes} [Fri May 27 08:29:46 2022] GET /identity/v3/services/placement => generated 90 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 08:29:46.684074 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cd79c6-9bf7-4134-8462-06011f3d4fc9 None None] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:29:46.705416 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:29:46.797955 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cd79c6-9bf7-4134-8462-06011f3d4fc9 None None] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:29:46.834315 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e43daf-f44b-49d0-84d6-dc5b12276c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:29:46.834979 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e43daf-f44b-49d0-84d6-dc5b12276c2a None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:29:46.835266 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e43daf-f44b-49d0-84d6-dc5b12276c2a None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:29:46.835543 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e43daf-f44b-49d0-84d6-dc5b12276c2a None admin] PATH_INFO: `/v3/services` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:29:46.836296 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e43daf-f44b-49d0-84d6-dc5b12276c2a None admin] RBAC: Adding query filter params (name=placement) {{(pid=87173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:29:46.836620 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e43daf-f44b-49d0-84d6-dc5b12276c2a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:29:46.838259 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e43daf-f44b-49d0-84d6-dc5b12276c2a None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:29:46.844277 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 461/920] 10.222.0.62 () {56 vars in 1116 bytes} [Fri May 27 08:29:46 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:29:46.850249 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e998ba-3c9b-4a0e-839a-c1b1ecbaafd3 None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:29:46.881216 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:29:46.954891 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e998ba-3c9b-4a0e-839a-c1b1ecbaafd3 None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:29:46.988258 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec0ad4c-037d-421f-a8f0-3160a63366d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:29:46.988977 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec0ad4c-037d-421f-a8f0-3160a63366d5 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:29:46.989263 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec0ad4c-037d-421f-a8f0-3160a63366d5 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:29:46.989542 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec0ad4c-037d-421f-a8f0-3160a63366d5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:29:46.990341 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec0ad4c-037d-421f-a8f0-3160a63366d5 None admin] RBAC: Adding query filter params (interface=public, service_id=a2f1dbc15e3f4a1e9d6afe12ff202aa4, region_id=RegionOne) {{(pid=87172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:29:46.990652 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec0ad4c-037d-421f-a8f0-3160a63366d5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:29:46.992034 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec0ad4c-037d-421f-a8f0-3160a63366d5 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:29:46.997866 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 460/921] 10.222.0.62 () {56 vars in 1251 bytes} [Fri May 27 08:29:46 2022] GET /identity/v3/endpoints?service_id=a2f1dbc15e3f4a1e9d6afe12ff202aa4&interface=public®ion_id=RegionOne => generated 194 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:29:47.003500 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e43daf-f44b-49d0-84d6-dc5b12276c2a None admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:29:47.088563 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:29:47.107825 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e43daf-f44b-49d0-84d6-dc5b12276c2a None admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:29:47.141497 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7428f85b-d2fd-49c6-8b1d-fc8fde203195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:29:47.142161 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7428f85b-d2fd-49c6-8b1d-fc8fde203195 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:29:47.142453 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7428f85b-d2fd-49c6-8b1d-fc8fde203195 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:29:47.142733 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7428f85b-d2fd-49c6-8b1d-fc8fde203195 None admin] PATH_INFO: `/v3/services` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:29:47.143414 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7428f85b-d2fd-49c6-8b1d-fc8fde203195 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:29:47.144824 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7428f85b-d2fd-49c6-8b1d-fc8fde203195 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:29:47.151766 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 462/922] 10.222.0.62 () {56 vars in 1087 bytes} [Fri May 27 08:29:47 2022] GET /identity/v3/services => generated 1962 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 08:29:49.428367 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9336c59f-3cfa-4735-a29f-d531f4637a21 None None] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:29:49.428994 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9336c59f-3cfa-4735-a29f-d531f4637a21 None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:29:49.428994 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9336c59f-3cfa-4735-a29f-d531f4637a21 None None] PATH_INFO: `/` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:29:49.430931 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 461/923] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:29:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:29:49.436292 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e1d297-f66c-406b-8d9f-4b31504abdb7 None None] REQUEST_METHOD: `POST` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:29:49.436770 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e1d297-f66c-406b-8d9f-4b31504abdb7 None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:29:49.436893 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e1d297-f66c-406b-8d9f-4b31504abdb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:29:49.454563 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.auth.core [None req-e1e1d297-f66c-406b-8d9f-4b31504abdb7 None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:29:49.455781 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.fernet_utils [None req-e1e1d297-f66c-406b-8d9f-4b31504abdb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:29:49.527714 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 463/924] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:29:49 2022] POST /identity/v3/auth/tokens => generated 1962 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 27 08:29:49.551649 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9336c59f-3cfa-4735-a29f-d531f4637a21 None None] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:29:49.645692 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:29:49.655892 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9336c59f-3cfa-4735-a29f-d531f4637a21 None None] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:29:49.690094 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4726d4-57bc-412a-97cb-0bfd1e784a53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:29:49.690882 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4726d4-57bc-412a-97cb-0bfd1e784a53 None admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:29:49.691091 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4726d4-57bc-412a-97cb-0bfd1e784a53 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:29:49.691366 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4726d4-57bc-412a-97cb-0bfd1e784a53 None admin] PATH_INFO: `/v3/services/placement` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:29:49.692010 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4726d4-57bc-412a-97cb-0bfd1e784a53 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:29:49.693422 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4726d4-57bc-412a-97cb-0bfd1e784a53 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:29:49.705790 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application [None req-5c4726d4-57bc-412a-97cb-0bfd1e784a53 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 27 08:29:49.705790 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:29:49.705790 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 27 08:29:49.705790 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 27 08:29:49.705790 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 27 08:29:49.705790 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 27 08:29:49.705790 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 27 08:29:49.705790 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 08:29:49.705790 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 27 08:29:49.705790 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application May 27 08:29:49.705790 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 27 08:29:49.705790 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application May 27 08:29:49.705790 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application Traceback (most recent call last): May 27 08:29:49.705790 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 27 08:29:49.705790 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 27 08:29:49.705790 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 27 08:29:49.705790 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 27 08:29:49.707019 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 27 08:29:49.707019 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 27 08:29:49.707019 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 27 08:29:49.707019 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 27 08:29:49.707019 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 27 08:29:49.707019 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 27 08:29:49.707019 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 27 08:29:49.707019 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._get_service(service_id) May 27 08:29:49.707019 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 27 08:29:49.707019 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 27 08:29:49.707019 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 27 08:29:49.707019 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 27 08:29:49.707019 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 27 08:29:49.707019 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 27 08:29:49.707019 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 27 08:29:49.707019 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.get_or_create( May 27 08:29:49.707975 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 27 08:29:49.707975 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application with Lock( May 27 08:29:49.707975 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 27 08:29:49.707975 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self._enter() May 27 08:29:49.707975 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 27 08:29:49.707975 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 27 08:29:49.707975 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 27 08:29:49.707975 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application return self.creator() May 27 08:29:49.707975 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 27 08:29:49.707975 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application created_value = creator( May 27 08:29:49.707975 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 27 08:29:49.707975 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 27 08:29:49.707975 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 27 08:29:49.707975 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: ERROR keystone.server.flask.application May 27 08:29:49.707975 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 462/925] 10.222.0.62 () {56 vars in 1117 bytes} [Fri May 27 08:29:49 2022] GET /identity/v3/services/placement => generated 90 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 27 08:29:49.714662 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e1d297-f66c-406b-8d9f-4b31504abdb7 None None] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:29:49.794154 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:29:49.816994 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e1d297-f66c-406b-8d9f-4b31504abdb7 None None] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:29:49.853225 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b977295c-73ba-4384-bbe2-f63ff8fee642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:29:49.853898 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b977295c-73ba-4384-bbe2-f63ff8fee642 None admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:29:49.854181 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b977295c-73ba-4384-bbe2-f63ff8fee642 None admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:29:49.854464 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b977295c-73ba-4384-bbe2-f63ff8fee642 None admin] PATH_INFO: `/v3/services` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:29:49.855175 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b977295c-73ba-4384-bbe2-f63ff8fee642 None admin] RBAC: Adding query filter params (name=placement) {{(pid=87173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:29:49.855480 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b977295c-73ba-4384-bbe2-f63ff8fee642 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:29:49.856902 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b977295c-73ba-4384-bbe2-f63ff8fee642 None admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:29:49.862301 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 464/926] 10.222.0.62 () {56 vars in 1116 bytes} [Fri May 27 08:29:49 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 08:29:49.870952 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4726d4-57bc-412a-97cb-0bfd1e784a53 None admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:29:49.976356 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4726d4-57bc-412a-97cb-0bfd1e784a53 None admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:29:50.010712 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b8ff9f-7ca0-4ea9-b2f3-7bddc73d6541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:29:50.011368 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b8ff9f-7ca0-4ea9-b2f3-7bddc73d6541 None admin] REQUEST_METHOD: `POST` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:29:50.011653 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b8ff9f-7ca0-4ea9-b2f3-7bddc73d6541 None admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:29:50.011937 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b8ff9f-7ca0-4ea9-b2f3-7bddc73d6541 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:29:50.012719 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b8ff9f-7ca0-4ea9-b2f3-7bddc73d6541 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:29:50.014097 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b8ff9f-7ca0-4ea9-b2f3-7bddc73d6541 None admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:29:50.033247 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 463/927] 10.222.0.62 () {60 vars in 1144 bytes} [Fri May 27 08:29:49 2022] POST /identity/v3/endpoints => generated 331 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 08:29:59.859788 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=30 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:30:00.028578 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=93,keystone:INSERT=1 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:30:52.144210 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21f1577-b78c-43eb-aae7-65b1e124fbec None None] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:30:52.144805 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21f1577-b78c-43eb-aae7-65b1e124fbec None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:30:52.145034 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21f1577-b78c-43eb-aae7-65b1e124fbec None None] PATH_INFO: `/` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:30:52.146613 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 465/928] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:30:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:30:52.155246 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfb8d5d-f6f9-423f-8005-76b3bb31bb36 None None] REQUEST_METHOD: `POST` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:30:52.155781 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfb8d5d-f6f9-423f-8005-76b3bb31bb36 None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:30:52.156297 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfb8d5d-f6f9-423f-8005-76b3bb31bb36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:30:52.186470 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.auth.core [None req-acfb8d5d-f6f9-423f-8005-76b3bb31bb36 None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:30:52.188411 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.fernet_utils [None req-acfb8d5d-f6f9-423f-8005-76b3bb31bb36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:30:52.283448 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 464/929] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:30:52 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 08:30:52.343632 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac3cea8-6cf8-425b-b8ce-06cbd6174ad7 None None] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:30:52.344170 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac3cea8-6cf8-425b-b8ce-06cbd6174ad7 None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:30:52.344531 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac3cea8-6cf8-425b-b8ce-06cbd6174ad7 None None] PATH_INFO: `/` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:30:52.346579 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 466/930] 10.222.0.62 () {54 vars in 964 bytes} [Fri May 27 08:30:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:30:52.353873 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86230286-e86c-49f7-a35e-ed542de74e5b None None] REQUEST_METHOD: `POST` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:30:52.354247 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86230286-e86c-49f7-a35e-ed542de74e5b None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:30:52.354585 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86230286-e86c-49f7-a35e-ed542de74e5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:30:52.450042 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.auth.core [None req-86230286-e86c-49f7-a35e-ed542de74e5b None None] MFA Rules not processed for user `56934ba9afb741679e0573167d6825f5`. Rule list: `[]` (Enabled: `True`). {{(pid=87172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:30:52.451280 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.fernet_utils [None req-86230286-e86c-49f7-a35e-ed542de74e5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:30:52.516184 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 465/931] 10.222.0.62 () {58 vars in 1061 bytes} [Fri May 27 08:30:52 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 08:30:52.525666 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac3cea8-6cf8-425b-b8ce-06cbd6174ad7 None None] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:30:52.537871 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac3cea8-6cf8-425b-b8ce-06cbd6174ad7 None None] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:30:52.541449 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eda118-43b8-4d2a-9a2f-93c1b06d196b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56934ba9afb741679e0573167d6825f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '256f4731060449f1b80067e51e8bec00', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:30:52.542091 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eda118-43b8-4d2a-9a2f-93c1b06d196b service neutron] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:30:52.542376 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eda118-43b8-4d2a-9a2f-93c1b06d196b service neutron] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:30:52.542654 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eda118-43b8-4d2a-9a2f-93c1b06d196b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:30:52.552501 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61eda118-43b8-4d2a-9a2f-93c1b06d196b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:30:52.553985 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61eda118-43b8-4d2a-9a2f-93c1b06d196b service neutron] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:30:52.563807 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 467/932] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 08:30:52 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 08:30:55.157953 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2d67c4-143b-46fc-9106-2c4d077949cd None None] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:30:55.158642 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2d67c4-143b-46fc-9106-2c4d077949cd None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:30:55.158642 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2d67c4-143b-46fc-9106-2c4d077949cd None None] PATH_INFO: `/` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:30:55.160052 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 466/933] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:30:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:30:55.166073 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b25d479-5eb4-4b79-8707-2409ae5c3e85 None None] REQUEST_METHOD: `POST` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:30:55.166619 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b25d479-5eb4-4b79-8707-2409ae5c3e85 None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:30:55.166619 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b25d479-5eb4-4b79-8707-2409ae5c3e85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:30:55.186858 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.auth.core [None req-5b25d479-5eb4-4b79-8707-2409ae5c3e85 None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:30:55.188385 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.fernet_utils [None req-5b25d479-5eb4-4b79-8707-2409ae5c3e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:30:55.197723 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 468/934] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:30:55 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 08:30:55.240017 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2d67c4-143b-46fc-9106-2c4d077949cd None None] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:30:55.251110 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2d67c4-143b-46fc-9106-2c4d077949cd None None] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:30:55.255566 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cf5e4c-5904-4cd3-95f3-b8c5b6f6e9d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56934ba9afb741679e0573167d6825f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '256f4731060449f1b80067e51e8bec00', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:30:55.256200 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cf5e4c-5904-4cd3-95f3-b8c5b6f6e9d2 service neutron] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:30:55.256518 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cf5e4c-5904-4cd3-95f3-b8c5b6f6e9d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:30:55.256788 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cf5e4c-5904-4cd3-95f3-b8c5b6f6e9d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:30:55.266877 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cf5e4c-5904-4cd3-95f3-b8c5b6f6e9d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:30:55.268358 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cf5e4c-5904-4cd3-95f3-b8c5b6f6e9d2 service neutron] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:30:55.280207 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 467/935] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 08:30:55 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 08:30:58.012702 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0136234-8966-4a7c-8586-fe4cef4ba17e None None] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:30:58.013218 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0136234-8966-4a7c-8586-fe4cef4ba17e None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:30:58.013218 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0136234-8966-4a7c-8586-fe4cef4ba17e None None] PATH_INFO: `/` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:30:58.014589 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 469/936] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:30:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 08:30:58.021025 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f6a019-9bda-4a50-a767-56c6f40b7b83 None None] REQUEST_METHOD: `POST` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:30:58.021857 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f6a019-9bda-4a50-a767-56c6f40b7b83 None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:30:58.021857 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f6a019-9bda-4a50-a767-56c6f40b7b83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:30:58.064581 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.auth.core [None req-41f6a019-9bda-4a50-a767-56c6f40b7b83 None None] MFA Rules not processed for user `f12e0800a0284df5b6aec65ab2d4e334`. Rule list: `[]` (Enabled: `True`). {{(pid=87172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:30:58.065850 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.fernet_utils [None req-41f6a019-9bda-4a50-a767-56c6f40b7b83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:30:58.108783 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:30:58.138809 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 468/937] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:30:58 2022] POST /identity/v3/auth/tokens => generated 2793 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 08:30:58.183057 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0136234-8966-4a7c-8586-fe4cef4ba17e None None] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:30:58.194504 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0136234-8966-4a7c-8586-fe4cef4ba17e None None] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:30:58.198945 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb31b92e-7692-4475-bd99-0bbdc24e3053 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56934ba9afb741679e0573167d6825f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '256f4731060449f1b80067e51e8bec00', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:30:58.199702 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb31b92e-7692-4475-bd99-0bbdc24e3053 service neutron] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:30:58.200059 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb31b92e-7692-4475-bd99-0bbdc24e3053 service neutron] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:30:58.200409 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb31b92e-7692-4475-bd99-0bbdc24e3053 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:30:58.211118 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb31b92e-7692-4475-bd99-0bbdc24e3053 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:30:58.212709 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb31b92e-7692-4475-bd99-0bbdc24e3053 service neutron] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:30:58.223764 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 470/938] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 08:30:58 2022] GET /identity/v3/auth/tokens => generated 2793 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 08:31:01.406989 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d7a973-c538-4aa6-a760-fb3cd9fcbd89 None None] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:31:01.407561 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d7a973-c538-4aa6-a760-fb3cd9fcbd89 None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:31:01.407561 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d7a973-c538-4aa6-a760-fb3cd9fcbd89 None None] PATH_INFO: `/` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:31:01.408984 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 469/939] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:31:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 08:31:01.415705 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3873a208-c4ca-4fac-ba0d-579197865056 None None] REQUEST_METHOD: `POST` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:31:01.416256 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3873a208-c4ca-4fac-ba0d-579197865056 None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:31:01.416256 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3873a208-c4ca-4fac-ba0d-579197865056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:31:01.436493 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.auth.core [None req-3873a208-c4ca-4fac-ba0d-579197865056 None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:31:01.437782 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.fernet_utils [None req-3873a208-c4ca-4fac-ba0d-579197865056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:31:01.511797 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 471/940] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:31:01 2022] POST /identity/v3/auth/tokens => generated 2788 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 08:31:01.555426 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d7a973-c538-4aa6-a760-fb3cd9fcbd89 None None] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:31:01.567283 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d7a973-c538-4aa6-a760-fb3cd9fcbd89 None None] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:31:01.570728 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b111b03-08ab-49c1-9139-c41f51c94ece service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56934ba9afb741679e0573167d6825f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '256f4731060449f1b80067e51e8bec00', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:31:01.571360 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b111b03-08ab-49c1-9139-c41f51c94ece service neutron] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:31:01.571643 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b111b03-08ab-49c1-9139-c41f51c94ece service neutron] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:31:01.571918 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b111b03-08ab-49c1-9139-c41f51c94ece service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:31:01.581480 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b111b03-08ab-49c1-9139-c41f51c94ece service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:31:01.582968 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b111b03-08ab-49c1-9139-c41f51c94ece service neutron] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:31:01.592803 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 470/941] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 08:31:01 2022] GET /identity/v3/auth/tokens => generated 2788 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 08:31:04.830405 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447140aa-a002-41b6-8b1c-bd24155deb73 None None] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:31:04.830930 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447140aa-a002-41b6-8b1c-bd24155deb73 None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:31:04.831019 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447140aa-a002-41b6-8b1c-bd24155deb73 None None] PATH_INFO: `/` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:31:04.832737 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 472/942] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:31:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:31:04.838626 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087e7a64-a311-47ff-947d-b7d3cc6fa8ef None None] REQUEST_METHOD: `POST` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:31:04.839166 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087e7a64-a311-47ff-947d-b7d3cc6fa8ef None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:31:04.839166 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087e7a64-a311-47ff-947d-b7d3cc6fa8ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:31:04.862535 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.auth.core [None req-087e7a64-a311-47ff-947d-b7d3cc6fa8ef None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:31:04.864337 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.fernet_utils [None req-087e7a64-a311-47ff-947d-b7d3cc6fa8ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:31:04.872683 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 471/943] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:31:04 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 08:31:04.911701 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447140aa-a002-41b6-8b1c-bd24155deb73 None None] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:31:04.922799 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447140aa-a002-41b6-8b1c-bd24155deb73 None None] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:31:04.927163 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b118d0-2792-4a7a-9383-cc4d4a5aac11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56934ba9afb741679e0573167d6825f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '256f4731060449f1b80067e51e8bec00', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:31:04.927818 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b118d0-2792-4a7a-9383-cc4d4a5aac11 service neutron] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:31:04.928102 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b118d0-2792-4a7a-9383-cc4d4a5aac11 service neutron] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:31:04.928378 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b118d0-2792-4a7a-9383-cc4d4a5aac11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:31:04.939115 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b118d0-2792-4a7a-9383-cc4d4a5aac11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:31:04.940603 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b118d0-2792-4a7a-9383-cc4d4a5aac11 service neutron] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:31:04.951655 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 473/944] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 08:31:04 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 08:31:07.377041 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f208236-03c1-44d2-b95a-d4702b70db31 None None] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:31:07.377408 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f208236-03c1-44d2-b95a-d4702b70db31 None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:31:07.377408 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f208236-03c1-44d2-b95a-d4702b70db31 None None] PATH_INFO: `/` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:31:07.379293 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 472/945] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:31:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:31:07.384955 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192f188d-f0b3-4603-a5b9-1abd0704cbee None None] REQUEST_METHOD: `POST` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:31:07.385413 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192f188d-f0b3-4603-a5b9-1abd0704cbee None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:31:07.385517 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192f188d-f0b3-4603-a5b9-1abd0704cbee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:31:07.404985 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.auth.core [None req-192f188d-f0b3-4603-a5b9-1abd0704cbee None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:31:07.406449 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.fernet_utils [None req-192f188d-f0b3-4603-a5b9-1abd0704cbee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:31:07.416298 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 474/946] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:31:07 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 08:31:07.455097 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f208236-03c1-44d2-b95a-d4702b70db31 None None] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:31:07.467295 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f208236-03c1-44d2-b95a-d4702b70db31 None None] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:31:07.470858 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bd5787-107b-40c9-8d8a-f35d8f715e68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56934ba9afb741679e0573167d6825f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '256f4731060449f1b80067e51e8bec00', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:31:07.471610 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bd5787-107b-40c9-8d8a-f35d8f715e68 service neutron] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:31:07.472061 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bd5787-107b-40c9-8d8a-f35d8f715e68 service neutron] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:31:07.472919 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bd5787-107b-40c9-8d8a-f35d8f715e68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:31:07.482745 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bd5787-107b-40c9-8d8a-f35d8f715e68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:31:07.484196 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bd5787-107b-40c9-8d8a-f35d8f715e68 service neutron] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:31:07.494516 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 473/947] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 08:31:07 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 08:31:09.923184 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cbf3ca-d4ec-4bee-b834-1b7991347790 None None] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:31:09.923744 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cbf3ca-d4ec-4bee-b834-1b7991347790 None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:31:09.923744 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cbf3ca-d4ec-4bee-b834-1b7991347790 None None] PATH_INFO: `/` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:31:09.925831 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 475/948] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:31:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:31:09.931042 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c7c4db-7ba2-44a6-bbf1-6cbafaa3229e None None] REQUEST_METHOD: `POST` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:31:09.931517 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c7c4db-7ba2-44a6-bbf1-6cbafaa3229e None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:31:09.931608 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c7c4db-7ba2-44a6-bbf1-6cbafaa3229e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:31:09.950156 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.auth.core [None req-b5c7c4db-7ba2-44a6-bbf1-6cbafaa3229e None None] MFA Rules not processed for user `f12e0800a0284df5b6aec65ab2d4e334`. Rule list: `[]` (Enabled: `True`). {{(pid=87172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:31:09.951365 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.fernet_utils [None req-b5c7c4db-7ba2-44a6-bbf1-6cbafaa3229e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:31:09.959317 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 474/949] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:31:09 2022] POST /identity/v3/auth/tokens => generated 2793 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 08:31:09.999929 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cbf3ca-d4ec-4bee-b834-1b7991347790 None None] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:31:10.011025 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cbf3ca-d4ec-4bee-b834-1b7991347790 None None] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:31:10.014595 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be971ec4-c7ec-458d-bf21-90085b4e97ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56934ba9afb741679e0573167d6825f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '256f4731060449f1b80067e51e8bec00', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:31:10.015230 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be971ec4-c7ec-458d-bf21-90085b4e97ec service neutron] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:31:10.015511 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be971ec4-c7ec-458d-bf21-90085b4e97ec service neutron] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:31:10.015783 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be971ec4-c7ec-458d-bf21-90085b4e97ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:31:10.024864 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be971ec4-c7ec-458d-bf21-90085b4e97ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:31:10.026317 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be971ec4-c7ec-458d-bf21-90085b4e97ec service neutron] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:31:10.036677 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 476/950] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 08:31:09 2022] GET /identity/v3/auth/tokens => generated 2793 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 08:31:12.582953 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c21899-9c79-4995-960a-428fe98a563b None None] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:31:12.583600 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c21899-9c79-4995-960a-428fe98a563b None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:31:12.583600 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c21899-9c79-4995-960a-428fe98a563b None None] PATH_INFO: `/` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:31:12.585104 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 475/951] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:31:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 08:31:12.591458 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c85fcc-4042-4397-ba25-0ab235bcc211 None None] REQUEST_METHOD: `POST` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:31:12.591990 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c85fcc-4042-4397-ba25-0ab235bcc211 None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:31:12.592132 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c85fcc-4042-4397-ba25-0ab235bcc211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:31:12.611463 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.auth.core [None req-b1c85fcc-4042-4397-ba25-0ab235bcc211 None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:31:12.613514 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.fernet_utils [None req-b1c85fcc-4042-4397-ba25-0ab235bcc211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:31:12.624118 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 477/952] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:31:12 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 08:31:12.667794 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c21899-9c79-4995-960a-428fe98a563b None None] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:31:12.679165 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c21899-9c79-4995-960a-428fe98a563b None None] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:31:12.682704 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35103761-f737-4aac-96ef-061ddd8514ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56934ba9afb741679e0573167d6825f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '256f4731060449f1b80067e51e8bec00', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:31:12.683340 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35103761-f737-4aac-96ef-061ddd8514ac service neutron] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:31:12.683619 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35103761-f737-4aac-96ef-061ddd8514ac service neutron] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:31:12.683890 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35103761-f737-4aac-96ef-061ddd8514ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:31:12.694395 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35103761-f737-4aac-96ef-061ddd8514ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:31:12.695826 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35103761-f737-4aac-96ef-061ddd8514ac service neutron] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:31:12.705391 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 476/953] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 08:31:12 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 08:31:15.098030 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650f4f5f-6b53-4417-bf58-c23660c95e13 None None] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:31:15.098525 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650f4f5f-6b53-4417-bf58-c23660c95e13 None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:31:15.098525 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650f4f5f-6b53-4417-bf58-c23660c95e13 None None] PATH_INFO: `/` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:31:15.099866 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 478/954] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:31:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:31:15.105312 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9497e4-9361-4df6-a46b-c9f958c67eb8 None None] REQUEST_METHOD: `POST` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:31:15.105726 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9497e4-9361-4df6-a46b-c9f958c67eb8 None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:31:15.105885 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9497e4-9361-4df6-a46b-c9f958c67eb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:31:15.123970 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.auth.core [None req-ae9497e4-9361-4df6-a46b-c9f958c67eb8 None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:31:15.125213 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.fernet_utils [None req-ae9497e4-9361-4df6-a46b-c9f958c67eb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:31:15.133852 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 477/955] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:31:15 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 08:31:15.177005 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650f4f5f-6b53-4417-bf58-c23660c95e13 None None] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:31:15.189180 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650f4f5f-6b53-4417-bf58-c23660c95e13 None None] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:31:15.193565 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2e89ea-bfde-4623-aebd-f2695a67ee71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56934ba9afb741679e0573167d6825f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '256f4731060449f1b80067e51e8bec00', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:31:15.194219 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2e89ea-bfde-4623-aebd-f2695a67ee71 service neutron] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:31:15.194505 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2e89ea-bfde-4623-aebd-f2695a67ee71 service neutron] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:31:15.194779 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2e89ea-bfde-4623-aebd-f2695a67ee71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:31:15.205041 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2e89ea-bfde-4623-aebd-f2695a67ee71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:31:15.207304 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2e89ea-bfde-4623-aebd-f2695a67ee71 service neutron] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:31:15.218083 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 479/956] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 08:31:15 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 08:31:18.032317 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b49190-79b7-4c3a-98aa-8e2f2ac4ade6 None None] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:31:18.032919 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b49190-79b7-4c3a-98aa-8e2f2ac4ade6 None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:31:18.032919 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b49190-79b7-4c3a-98aa-8e2f2ac4ade6 None None] PATH_INFO: `/` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:31:18.034658 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 478/957] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:31:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:31:18.041039 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f8396c-12c3-44eb-be25-cffad3ed5ed4 None None] REQUEST_METHOD: `POST` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:31:18.041591 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f8396c-12c3-44eb-be25-cffad3ed5ed4 None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:31:18.041591 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f8396c-12c3-44eb-be25-cffad3ed5ed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:31:18.067836 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.auth.core [None req-20f8396c-12c3-44eb-be25-cffad3ed5ed4 None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:31:18.069293 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.fernet_utils [None req-20f8396c-12c3-44eb-be25-cffad3ed5ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:31:18.077309 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 480/958] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:31:18 2022] POST /identity/v3/auth/tokens => generated 2788 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 08:31:18.120072 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b49190-79b7-4c3a-98aa-8e2f2ac4ade6 None None] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:31:18.135998 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b49190-79b7-4c3a-98aa-8e2f2ac4ade6 None None] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:31:18.139726 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1668417-5952-4437-86f3-49245f549bc2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56934ba9afb741679e0573167d6825f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '256f4731060449f1b80067e51e8bec00', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:31:18.140425 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1668417-5952-4437-86f3-49245f549bc2 service neutron] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:31:18.140741 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1668417-5952-4437-86f3-49245f549bc2 service neutron] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:31:18.141019 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1668417-5952-4437-86f3-49245f549bc2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:31:18.151609 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1668417-5952-4437-86f3-49245f549bc2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:31:18.153171 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1668417-5952-4437-86f3-49245f549bc2 service neutron] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:31:18.164309 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 479/959] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 08:31:18 2022] GET /identity/v3/auth/tokens => generated 2788 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 08:31:22.627223 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833da703-5d40-48b3-8218-268037580e9f None None] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:31:22.628092 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833da703-5d40-48b3-8218-268037580e9f None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:31:22.628092 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833da703-5d40-48b3-8218-268037580e9f None None] PATH_INFO: `/` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:31:22.629504 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 481/960] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:31:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:31:22.634674 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c64f95-6014-45f8-9175-eeeb8b0b9736 None None] REQUEST_METHOD: `POST` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:31:22.635110 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c64f95-6014-45f8-9175-eeeb8b0b9736 None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:31:22.635250 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c64f95-6014-45f8-9175-eeeb8b0b9736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:31:22.654430 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.auth.core [None req-f9c64f95-6014-45f8-9175-eeeb8b0b9736 None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:31:22.655625 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.fernet_utils [None req-f9c64f95-6014-45f8-9175-eeeb8b0b9736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:31:22.664456 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 480/961] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:31:22 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 08:31:22.705387 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833da703-5d40-48b3-8218-268037580e9f None None] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:31:22.711274 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=74 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:31:22.717930 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833da703-5d40-48b3-8218-268037580e9f None None] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:31:22.721444 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15220a38-b8b7-4dc0-b51d-3083e7506a9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56934ba9afb741679e0573167d6825f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '256f4731060449f1b80067e51e8bec00', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:31:22.722085 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15220a38-b8b7-4dc0-b51d-3083e7506a9b service neutron] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:31:22.722366 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15220a38-b8b7-4dc0-b51d-3083e7506a9b service neutron] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:31:22.722643 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15220a38-b8b7-4dc0-b51d-3083e7506a9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:31:22.731839 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15220a38-b8b7-4dc0-b51d-3083e7506a9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:31:22.733314 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15220a38-b8b7-4dc0-b51d-3083e7506a9b service neutron] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:31:22.742743 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 482/962] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 08:31:22 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 08:31:25.761967 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c6c5fa-e9d8-4087-9bfa-3795fd51b064 None None] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:31:25.762904 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c6c5fa-e9d8-4087-9bfa-3795fd51b064 None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:31:25.763193 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c6c5fa-e9d8-4087-9bfa-3795fd51b064 None None] PATH_INFO: `/` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:31:25.764578 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 481/963] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:31:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:31:25.770861 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b636e3-e2af-465a-8979-ff963e822728 None None] REQUEST_METHOD: `POST` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:31:25.771321 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b636e3-e2af-465a-8979-ff963e822728 None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:31:25.771516 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b636e3-e2af-465a-8979-ff963e822728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:31:25.789682 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.auth.core [None req-03b636e3-e2af-465a-8979-ff963e822728 None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:31:25.790885 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.fernet_utils [None req-03b636e3-e2af-465a-8979-ff963e822728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:31:25.798771 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 483/964] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:31:25 2022] POST /identity/v3/auth/tokens => generated 2788 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 08:31:25.837758 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c6c5fa-e9d8-4087-9bfa-3795fd51b064 None None] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:31:25.849617 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c6c5fa-e9d8-4087-9bfa-3795fd51b064 None None] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:31:25.853204 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42747e1e-c8c0-4ea1-9c5f-cbb35e15fe3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56934ba9afb741679e0573167d6825f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '256f4731060449f1b80067e51e8bec00', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:31:25.853844 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42747e1e-c8c0-4ea1-9c5f-cbb35e15fe3d service neutron] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:31:25.854156 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42747e1e-c8c0-4ea1-9c5f-cbb35e15fe3d service neutron] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:31:25.854436 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42747e1e-c8c0-4ea1-9c5f-cbb35e15fe3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:31:25.864465 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42747e1e-c8c0-4ea1-9c5f-cbb35e15fe3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:31:25.865967 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42747e1e-c8c0-4ea1-9c5f-cbb35e15fe3d service neutron] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:31:25.878985 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 482/965] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 08:31:25 2022] GET /identity/v3/auth/tokens => generated 2788 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 08:31:30.263314 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7358eee-4a5b-4c53-b5da-90948da640dc None None] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:31:30.263836 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7358eee-4a5b-4c53-b5da-90948da640dc None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:31:30.263929 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7358eee-4a5b-4c53-b5da-90948da640dc None None] PATH_INFO: `/` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:31:30.265281 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 484/966] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:31:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:31:30.272046 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df1ec37-11b6-4385-853a-02d136842f2d None None] REQUEST_METHOD: `POST` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:31:30.272561 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df1ec37-11b6-4385-853a-02d136842f2d None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:31:30.272841 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df1ec37-11b6-4385-853a-02d136842f2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:31:30.279474 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=54 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:31:30.294015 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.auth.core [None req-6df1ec37-11b6-4385-853a-02d136842f2d None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:31:30.295243 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.fernet_utils [None req-6df1ec37-11b6-4385-853a-02d136842f2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:31:30.303634 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 483/967] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:31:30 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 08:31:30.345787 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7358eee-4a5b-4c53-b5da-90948da640dc None None] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:31:30.356780 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7358eee-4a5b-4c53-b5da-90948da640dc None None] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:31:30.360243 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4939c2c-91af-4a01-828d-3ef148339588 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56934ba9afb741679e0573167d6825f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '256f4731060449f1b80067e51e8bec00', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:31:30.360920 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4939c2c-91af-4a01-828d-3ef148339588 service neutron] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:31:30.361227 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4939c2c-91af-4a01-828d-3ef148339588 service neutron] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:31:30.361529 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4939c2c-91af-4a01-828d-3ef148339588 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:31:30.371258 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4939c2c-91af-4a01-828d-3ef148339588 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:31:30.372733 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4939c2c-91af-4a01-828d-3ef148339588 service neutron] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:31:30.383730 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 485/968] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 08:31:30 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 08:31:36.143419 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b21d88-a3e4-4928-a2a0-ca059b4ab493 None None] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:31:36.144203 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b21d88-a3e4-4928-a2a0-ca059b4ab493 None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:31:36.144203 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b21d88-a3e4-4928-a2a0-ca059b4ab493 None None] PATH_INFO: `/` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:31:36.147263 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 484/969] 10.222.0.62 () {54 vars in 921 bytes} [Fri May 27 08:31:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 08:31:36.152955 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43087012-1f7b-4171-8ff7-b8855e66256b None None] REQUEST_METHOD: `POST` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:31:36.153869 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43087012-1f7b-4171-8ff7-b8855e66256b None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:31:36.154374 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43087012-1f7b-4171-8ff7-b8855e66256b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:31:36.220068 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.auth.core [None req-43087012-1f7b-4171-8ff7-b8855e66256b None None] MFA Rules not processed for user `7b12a598052a4b749edb0c021d99b951`. Rule list: `[]` (Enabled: `True`). {{(pid=87173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:31:36.222116 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.fernet_utils [None req-43087012-1f7b-4171-8ff7-b8855e66256b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:31:36.309556 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 486/970] 10.222.0.62 () {58 vars in 1018 bytes} [Fri May 27 08:31:36 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 08:31:40.288180 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=2 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:31:41.152609 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88447c52-087e-480b-84f0-426a45b81b2f None None] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:31:41.153001 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88447c52-087e-480b-84f0-426a45b81b2f None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:31:41.153270 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88447c52-087e-480b-84f0-426a45b81b2f None None] PATH_INFO: `/` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:31:41.154997 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 485/971] 10.222.0.62 () {54 vars in 921 bytes} [Fri May 27 08:31:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:31:41.164190 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed7ad12-037b-4049-97e3-da6a49ecbe3a None None] REQUEST_METHOD: `POST` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:31:41.164190 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed7ad12-037b-4049-97e3-da6a49ecbe3a None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:31:41.164190 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed7ad12-037b-4049-97e3-da6a49ecbe3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:31:41.190187 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.auth.core [None req-8ed7ad12-037b-4049-97e3-da6a49ecbe3a None None] MFA Rules not processed for user `7b12a598052a4b749edb0c021d99b951`. Rule list: `[]` (Enabled: `True`). {{(pid=87173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:31:41.192145 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.fernet_utils [None req-8ed7ad12-037b-4049-97e3-da6a49ecbe3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:31:41.203540 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 487/972] 10.222.0.62 () {58 vars in 1018 bytes} [Fri May 27 08:31:41 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 08:31:42.903975 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a40813-ff75-40ee-b546-4ff24c2fc134 None None] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:31:42.904852 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a40813-ff75-40ee-b546-4ff24c2fc134 None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:31:42.904852 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a40813-ff75-40ee-b546-4ff24c2fc134 None None] PATH_INFO: `/` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:31:42.908474 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 486/973] 10.222.0.62 () {54 vars in 921 bytes} [Fri May 27 08:31:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:31:42.913842 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f335eb-9b9d-4b30-ad3d-1182fa461043 None None] REQUEST_METHOD: `POST` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:31:42.914353 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f335eb-9b9d-4b30-ad3d-1182fa461043 None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:31:42.914442 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f335eb-9b9d-4b30-ad3d-1182fa461043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:31:42.940342 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.auth.core [None req-05f335eb-9b9d-4b30-ad3d-1182fa461043 None None] MFA Rules not processed for user `7b12a598052a4b749edb0c021d99b951`. Rule list: `[]` (Enabled: `True`). {{(pid=87173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:31:42.942409 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.fernet_utils [None req-05f335eb-9b9d-4b30-ad3d-1182fa461043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:31:42.957007 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 488/974] 10.222.0.62 () {58 vars in 1018 bytes} [Fri May 27 08:31:42 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 08:31:47.258721 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f54a13-328f-468b-bc2b-47ce4ccaacab None None] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:31:47.259258 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f54a13-328f-468b-bc2b-47ce4ccaacab None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:31:47.259258 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f54a13-328f-468b-bc2b-47ce4ccaacab None None] PATH_INFO: `/` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:31:47.265127 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 487/975] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:31:47 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:31:47.266923 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121c4d71-283d-461e-8c9a-fe4ebb938d4e None None] REQUEST_METHOD: `POST` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:31:47.267395 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121c4d71-283d-461e-8c9a-fe4ebb938d4e None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:31:47.267849 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121c4d71-283d-461e-8c9a-fe4ebb938d4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:31:47.297144 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.auth.core [None req-121c4d71-283d-461e-8c9a-fe4ebb938d4e None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:31:47.301932 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.fernet_utils [None req-121c4d71-283d-461e-8c9a-fe4ebb938d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:31:47.312775 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 489/976] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:31:47 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 08:31:47.381938 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0a5ca7-503a-487f-934f-7552b2426385 None None] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:31:47.382699 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0a5ca7-503a-487f-934f-7552b2426385 None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:31:47.383230 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0a5ca7-503a-487f-934f-7552b2426385 None None] PATH_INFO: `/` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:31:47.385045 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 488/977] 10.222.0.62 () {54 vars in 961 bytes} [Fri May 27 08:31:47 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:31:47.395794 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c512c39-93a7-4250-a665-b1e7809a4ee9 None None] REQUEST_METHOD: `POST` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:31:47.396402 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c512c39-93a7-4250-a665-b1e7809a4ee9 None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:31:47.397347 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c512c39-93a7-4250-a665-b1e7809a4ee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:31:47.444021 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.auth.core [None req-1c512c39-93a7-4250-a665-b1e7809a4ee9 None None] MFA Rules not processed for user `3a09bdc2dbac4f9abe450ff121e7dce8`. Rule list: `[]` (Enabled: `True`). {{(pid=87173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:31:47.445532 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.fernet_utils [None req-1c512c39-93a7-4250-a665-b1e7809a4ee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:31:47.535150 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:31:47.549585 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0a5ca7-503a-487f-934f-7552b2426385 None None] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:31:47.550946 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 490/978] 10.222.0.62 () {58 vars in 1058 bytes} [Fri May 27 08:31:47 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 08:31:47.564486 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0a5ca7-503a-487f-934f-7552b2426385 None None] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:31:47.569791 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae16902-a340-4ae5-926c-f6f26f6feb50 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a09bdc2dbac4f9abe450ff121e7dce8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '256f4731060449f1b80067e51e8bec00', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:31:47.570467 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae16902-a340-4ae5-926c-f6f26f6feb50 service nova] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:31:47.570739 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae16902-a340-4ae5-926c-f6f26f6feb50 service nova] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:31:47.571206 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae16902-a340-4ae5-926c-f6f26f6feb50 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:31:47.580281 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae16902-a340-4ae5-926c-f6f26f6feb50 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:31:47.581932 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae16902-a340-4ae5-926c-f6f26f6feb50 service nova] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:31:47.595186 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 489/979] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 08:31:47 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 08:31:50.241497 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f6a53d-da8e-4c09-b054-7132c10c75f1 None None] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:31:50.242099 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f6a53d-da8e-4c09-b054-7132c10c75f1 None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:31:50.242099 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f6a53d-da8e-4c09-b054-7132c10c75f1 None None] PATH_INFO: `/` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:31:50.243703 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 491/980] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:31:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:31:50.249356 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dab1d6-a721-4909-85f9-b2cdea32bb73 None None] REQUEST_METHOD: `POST` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:31:50.249873 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dab1d6-a721-4909-85f9-b2cdea32bb73 None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:31:50.249990 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dab1d6-a721-4909-85f9-b2cdea32bb73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:31:50.270039 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.auth.core [None req-02dab1d6-a721-4909-85f9-b2cdea32bb73 None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:31:50.271379 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.fernet_utils [None req-02dab1d6-a721-4909-85f9-b2cdea32bb73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:31:50.280583 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 490/981] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:31:50 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 08:31:50.335957 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f6a53d-da8e-4c09-b054-7132c10c75f1 None None] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:31:50.353675 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f6a53d-da8e-4c09-b054-7132c10c75f1 None None] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:31:50.361373 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f0c72d-0508-48c6-8a11-0bffd46436cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a09bdc2dbac4f9abe450ff121e7dce8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '256f4731060449f1b80067e51e8bec00', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:31:50.362473 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f0c72d-0508-48c6-8a11-0bffd46436cd service nova] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:31:50.362804 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f0c72d-0508-48c6-8a11-0bffd46436cd service nova] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:31:50.363283 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f0c72d-0508-48c6-8a11-0bffd46436cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:31:50.374784 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f0c72d-0508-48c6-8a11-0bffd46436cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:31:50.376517 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f0c72d-0508-48c6-8a11-0bffd46436cd service nova] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:31:50.387958 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 492/982] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 08:31:50 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 08:31:53.312227 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0928ddc5-12a2-49af-b9ea-acd65377c761 None None] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:31:53.312852 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0928ddc5-12a2-49af-b9ea-acd65377c761 None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:31:53.312852 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0928ddc5-12a2-49af-b9ea-acd65377c761 None None] PATH_INFO: `/` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:31:53.314777 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 491/983] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:31:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 08:31:53.320924 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd39a919-9bcf-4f5a-9861-6e89c63856dc None None] REQUEST_METHOD: `POST` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:31:53.321663 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd39a919-9bcf-4f5a-9861-6e89c63856dc None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:31:53.321663 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd39a919-9bcf-4f5a-9861-6e89c63856dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:31:53.360526 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.auth.core [None req-dd39a919-9bcf-4f5a-9861-6e89c63856dc None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:31:53.362253 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.fernet_utils [None req-dd39a919-9bcf-4f5a-9861-6e89c63856dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:31:53.371539 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 493/984] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:31:53 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 08:31:53.434863 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13547178-3f43-4d12-b87b-a63381b6c659 None None] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:31:53.435389 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13547178-3f43-4d12-b87b-a63381b6c659 None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:31:53.435845 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13547178-3f43-4d12-b87b-a63381b6c659 None None] PATH_INFO: `/` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:31:53.437452 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 492/985] 10.222.0.62 () {54 vars in 961 bytes} [Fri May 27 08:31:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:31:53.453856 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc5145a-ce1a-4df0-99cf-f784d28061ad None None] REQUEST_METHOD: `POST` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:31:53.454236 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc5145a-ce1a-4df0-99cf-f784d28061ad None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:31:53.454950 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc5145a-ce1a-4df0-99cf-f784d28061ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:31:53.478114 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.auth.core [None req-acc5145a-ce1a-4df0-99cf-f784d28061ad None None] MFA Rules not processed for user `3a09bdc2dbac4f9abe450ff121e7dce8`. Rule list: `[]` (Enabled: `True`). {{(pid=87173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:31:53.479666 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.fernet_utils [None req-acc5145a-ce1a-4df0-99cf-f784d28061ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:31:53.495479 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 494/986] 10.222.0.62 () {58 vars in 1058 bytes} [Fri May 27 08:31:53 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 08:31:53.508054 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13547178-3f43-4d12-b87b-a63381b6c659 None None] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:31:53.531381 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13547178-3f43-4d12-b87b-a63381b6c659 None None] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:31:53.538780 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe4e4af-ea80-4a59-a0a6-533e9d539f0c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a09bdc2dbac4f9abe450ff121e7dce8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '256f4731060449f1b80067e51e8bec00', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:31:53.539627 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe4e4af-ea80-4a59-a0a6-533e9d539f0c service nova] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:31:53.539937 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe4e4af-ea80-4a59-a0a6-533e9d539f0c service nova] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:31:53.540332 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe4e4af-ea80-4a59-a0a6-533e9d539f0c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:31:53.553350 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe4e4af-ea80-4a59-a0a6-533e9d539f0c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:31:53.554986 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe4e4af-ea80-4a59-a0a6-533e9d539f0c service nova] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:31:53.585061 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 493/987] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 08:31:53 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 08:31:56.079623 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdeb46c-845e-4bbb-8577-e29f117dc2f1 None None] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:31:56.080788 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdeb46c-845e-4bbb-8577-e29f117dc2f1 None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:31:56.081316 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdeb46c-845e-4bbb-8577-e29f117dc2f1 None None] PATH_INFO: `/` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:31:56.083769 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 495/988] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:31:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:31:56.090343 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de31258-5c32-4e11-af77-a8e3d6703557 None None] REQUEST_METHOD: `POST` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:31:56.091378 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de31258-5c32-4e11-af77-a8e3d6703557 None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:31:56.092131 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de31258-5c32-4e11-af77-a8e3d6703557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:31:56.113994 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.auth.core [None req-9de31258-5c32-4e11-af77-a8e3d6703557 None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:31:56.115581 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.fernet_utils [None req-9de31258-5c32-4e11-af77-a8e3d6703557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:31:56.133272 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 494/989] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:31:56 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 08:31:56.178998 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdeb46c-845e-4bbb-8577-e29f117dc2f1 None None] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:31:56.193342 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdeb46c-845e-4bbb-8577-e29f117dc2f1 None None] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:31:56.198746 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c58551-bade-4b2b-90ed-2983d0dfb387 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a09bdc2dbac4f9abe450ff121e7dce8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '256f4731060449f1b80067e51e8bec00', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:31:56.199757 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c58551-bade-4b2b-90ed-2983d0dfb387 service nova] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:31:56.200259 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c58551-bade-4b2b-90ed-2983d0dfb387 service nova] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:31:56.200773 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c58551-bade-4b2b-90ed-2983d0dfb387 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:31:56.211133 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c58551-bade-4b2b-90ed-2983d0dfb387 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:31:56.213133 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c58551-bade-4b2b-90ed-2983d0dfb387 service nova] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:31:56.236430 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 496/990] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 08:31:56 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 08:31:58.390253 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c130eff-0025-4c4e-9352-348e7c93884a None None] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:31:58.390689 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c130eff-0025-4c4e-9352-348e7c93884a None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:31:58.390819 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c130eff-0025-4c4e-9352-348e7c93884a None None] PATH_INFO: `/` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:31:58.402042 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291c724c-6ea8-4ee6-a34a-b02f9968245f None None] REQUEST_METHOD: `POST` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:31:58.403176 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291c724c-6ea8-4ee6-a34a-b02f9968245f None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:31:58.403852 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291c724c-6ea8-4ee6-a34a-b02f9968245f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:31:58.407640 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 495/991] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:31:58 2022] GET /identity => generated 270 bytes in 18 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:31:58.440183 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.auth.core [None req-291c724c-6ea8-4ee6-a34a-b02f9968245f None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:31:58.441712 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.fernet_utils [None req-291c724c-6ea8-4ee6-a34a-b02f9968245f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:31:58.461667 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 497/992] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:31:58 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 08:31:58.741516 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefb0823-3663-4810-9581-e9d43d92a7c6 None None] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:31:58.741956 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefb0823-3663-4810-9581-e9d43d92a7c6 None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:31:58.742331 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefb0823-3663-4810-9581-e9d43d92a7c6 None None] PATH_INFO: `/` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:31:58.743834 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 496/993] 10.222.0.62 () {54 vars in 963 bytes} [Fri May 27 08:31:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 08:31:58.749562 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce008b4b-8f90-41c8-8247-4147a7587cbb None None] REQUEST_METHOD: `POST` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:31:58.750008 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce008b4b-8f90-41c8-8247-4147a7587cbb None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:31:58.751226 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce008b4b-8f90-41c8-8247-4147a7587cbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:31:58.796199 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.auth.core [None req-ce008b4b-8f90-41c8-8247-4147a7587cbb None None] MFA Rules not processed for user `839e73c51c5243b68335242a0d695842`. Rule list: `[]` (Enabled: `True`). {{(pid=87173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:31:58.797742 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.fernet_utils [None req-ce008b4b-8f90-41c8-8247-4147a7587cbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:31:58.884130 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 498/994] 10.222.0.62 () {58 vars in 1060 bytes} [Fri May 27 08:31:58 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 08:31:58.893803 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefb0823-3663-4810-9581-e9d43d92a7c6 None None] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:31:58.909806 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefb0823-3663-4810-9581-e9d43d92a7c6 None None] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:31:58.916572 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bac42c-833c-4453-b55f-d0abfac6bc19 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839e73c51c5243b68335242a0d695842', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '256f4731060449f1b80067e51e8bec00', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:31:58.917306 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bac42c-833c-4453-b55f-d0abfac6bc19 service cinder] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:31:58.918378 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bac42c-833c-4453-b55f-d0abfac6bc19 service cinder] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:31:58.918676 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bac42c-833c-4453-b55f-d0abfac6bc19 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:31:58.930024 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bac42c-833c-4453-b55f-d0abfac6bc19 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:31:58.931531 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bac42c-833c-4453-b55f-d0abfac6bc19 service cinder] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:31:58.944633 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 497/995] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 08:31:58 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 08:31:59.045299 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac7f681-9717-4ab7-ae5d-8280b8ce3fb5 None None] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:31:59.045581 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac7f681-9717-4ab7-ae5d-8280b8ce3fb5 None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:31:59.045778 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac7f681-9717-4ab7-ae5d-8280b8ce3fb5 None None] PATH_INFO: `/` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:31:59.049092 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 499/996] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:31:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 08:31:59.053658 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6fa961-4451-45ee-9a5b-bbed18416686 None None] REQUEST_METHOD: `POST` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:31:59.053938 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6fa961-4451-45ee-9a5b-bbed18416686 None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:31:59.054403 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6fa961-4451-45ee-9a5b-bbed18416686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:31:59.073414 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.auth.core [None req-8c6fa961-4451-45ee-9a5b-bbed18416686 None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:31:59.074642 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.fernet_utils [None req-8c6fa961-4451-45ee-9a5b-bbed18416686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:31:59.085035 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 498/997] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:31:59 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 08:31:59.130703 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac7f681-9717-4ab7-ae5d-8280b8ce3fb5 None None] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:31:59.145996 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac7f681-9717-4ab7-ae5d-8280b8ce3fb5 None None] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:31:59.151147 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6d6347-0487-4b41-825a-1d17a8260e33 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a09bdc2dbac4f9abe450ff121e7dce8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '256f4731060449f1b80067e51e8bec00', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:31:59.151803 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6d6347-0487-4b41-825a-1d17a8260e33 service nova] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:31:59.152080 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6d6347-0487-4b41-825a-1d17a8260e33 service nova] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:31:59.152546 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6d6347-0487-4b41-825a-1d17a8260e33 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:31:59.162917 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6d6347-0487-4b41-825a-1d17a8260e33 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:31:59.164539 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6d6347-0487-4b41-825a-1d17a8260e33 service nova] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:31:59.178455 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 500/998] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 08:31:59 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 08:32:02.197014 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ad7ffb-a1a4-4765-991d-caf9ab05e692 None None] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:32:02.197621 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ad7ffb-a1a4-4765-991d-caf9ab05e692 None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:32:02.197621 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ad7ffb-a1a4-4765-991d-caf9ab05e692 None None] PATH_INFO: `/` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:32:02.198785 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 499/999] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:32:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:32:02.206271 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437a6575-ff20-4792-9b82-869547ce46af None None] REQUEST_METHOD: `POST` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:32:02.206905 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437a6575-ff20-4792-9b82-869547ce46af None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:32:02.206905 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437a6575-ff20-4792-9b82-869547ce46af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:32:02.229099 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.auth.core [None req-437a6575-ff20-4792-9b82-869547ce46af None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:32:02.230526 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.fernet_utils [None req-437a6575-ff20-4792-9b82-869547ce46af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:32:02.241995 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 501/1000] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:32:02 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 08:32:02.295171 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ad7ffb-a1a4-4765-991d-caf9ab05e692 None None] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:32:02.311387 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ad7ffb-a1a4-4765-991d-caf9ab05e692 None None] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:32:02.317278 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fc2b6c-e42b-4dcf-9610-83cb997f2ada service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a09bdc2dbac4f9abe450ff121e7dce8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '256f4731060449f1b80067e51e8bec00', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:32:02.317969 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fc2b6c-e42b-4dcf-9610-83cb997f2ada service nova] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:32:02.318253 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fc2b6c-e42b-4dcf-9610-83cb997f2ada service nova] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:32:02.318537 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fc2b6c-e42b-4dcf-9610-83cb997f2ada service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:32:02.329034 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fc2b6c-e42b-4dcf-9610-83cb997f2ada service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:32:02.330714 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fc2b6c-e42b-4dcf-9610-83cb997f2ada service nova] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:32:02.342771 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 500/1001] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 08:32:02 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 08:32:04.923949 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03064d5-1984-4685-a7b2-6790fa963bc4 None None] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:32:04.924828 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03064d5-1984-4685-a7b2-6790fa963bc4 None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:32:04.925022 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03064d5-1984-4685-a7b2-6790fa963bc4 None None] PATH_INFO: `/` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:32:04.926866 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 502/1002] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:32:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:32:04.933453 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5037a49-a4c2-4c3f-8612-9d63febb972f None None] REQUEST_METHOD: `POST` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:32:04.934301 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5037a49-a4c2-4c3f-8612-9d63febb972f None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:32:04.934463 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5037a49-a4c2-4c3f-8612-9d63febb972f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:32:04.958939 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.auth.core [None req-b5037a49-a4c2-4c3f-8612-9d63febb972f None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:32:04.961041 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.fernet_utils [None req-b5037a49-a4c2-4c3f-8612-9d63febb972f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:32:04.976796 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 501/1003] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:32:04 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 08:32:05.028472 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03064d5-1984-4685-a7b2-6790fa963bc4 None None] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:32:05.046500 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03064d5-1984-4685-a7b2-6790fa963bc4 None None] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:32:05.053683 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d62685-6c14-4372-8d4d-92ce1d3fc731 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a09bdc2dbac4f9abe450ff121e7dce8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '256f4731060449f1b80067e51e8bec00', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:32:05.054364 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d62685-6c14-4372-8d4d-92ce1d3fc731 service nova] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:32:05.054651 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d62685-6c14-4372-8d4d-92ce1d3fc731 service nova] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:32:05.054935 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d62685-6c14-4372-8d4d-92ce1d3fc731 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:32:05.066070 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d62685-6c14-4372-8d4d-92ce1d3fc731 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:32:05.067726 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d62685-6c14-4372-8d4d-92ce1d3fc731 service nova] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:32:05.080467 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 503/1004] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 08:32:05 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 08:32:07.589262 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf05d3d0-583e-4c3f-a26e-25c2e49af3fd None None] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:32:07.590150 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf05d3d0-583e-4c3f-a26e-25c2e49af3fd None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:32:07.590150 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf05d3d0-583e-4c3f-a26e-25c2e49af3fd None None] PATH_INFO: `/` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:32:07.591595 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 502/1005] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:32:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 08:32:07.601359 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc840ce-74f5-402c-bedd-ed3f878bd132 None None] REQUEST_METHOD: `POST` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:32:07.602580 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc840ce-74f5-402c-bedd-ed3f878bd132 None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:32:07.603429 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc840ce-74f5-402c-bedd-ed3f878bd132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:32:07.634833 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.auth.core [None req-0cc840ce-74f5-402c-bedd-ed3f878bd132 None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:32:07.637767 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.fernet_utils [None req-0cc840ce-74f5-402c-bedd-ed3f878bd132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:32:07.650665 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 504/1006] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:32:07 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 08:32:07.729663 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf05d3d0-583e-4c3f-a26e-25c2e49af3fd None None] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:32:07.754770 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf05d3d0-583e-4c3f-a26e-25c2e49af3fd None None] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:32:07.762264 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfb426b-c83a-446b-9821-17d350a15a21 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a09bdc2dbac4f9abe450ff121e7dce8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '256f4731060449f1b80067e51e8bec00', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:32:07.763367 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfb426b-c83a-446b-9821-17d350a15a21 service nova] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:32:07.763848 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfb426b-c83a-446b-9821-17d350a15a21 service nova] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:32:07.764338 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfb426b-c83a-446b-9821-17d350a15a21 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:32:07.781887 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfb426b-c83a-446b-9821-17d350a15a21 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:32:07.785010 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfb426b-c83a-446b-9821-17d350a15a21 service nova] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:32:07.809175 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 503/1007] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 08:32:07 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 08:32:10.552141 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f021524-1917-419c-ae65-793293e29d4b None None] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:32:10.552714 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f021524-1917-419c-ae65-793293e29d4b None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:32:10.552714 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f021524-1917-419c-ae65-793293e29d4b None None] PATH_INFO: `/` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:32:10.554544 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 505/1008] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:32:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:32:10.564773 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a57c19e-10a0-4a4c-ad25-01ef14dbc2e7 None None] REQUEST_METHOD: `POST` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:32:10.565334 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a57c19e-10a0-4a4c-ad25-01ef14dbc2e7 None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:32:10.565643 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a57c19e-10a0-4a4c-ad25-01ef14dbc2e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:32:10.578953 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=43 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:32:10.601763 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.auth.core [None req-5a57c19e-10a0-4a4c-ad25-01ef14dbc2e7 None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:32:10.603660 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.fernet_utils [None req-5a57c19e-10a0-4a4c-ad25-01ef14dbc2e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:32:10.618374 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 504/1009] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:32:10 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 08:32:10.688132 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f021524-1917-419c-ae65-793293e29d4b None None] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:32:10.704531 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f021524-1917-419c-ae65-793293e29d4b None None] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:32:10.711887 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9965111b-ad8f-422a-8473-f50696b06997 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a09bdc2dbac4f9abe450ff121e7dce8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '256f4731060449f1b80067e51e8bec00', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:32:10.712409 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9965111b-ad8f-422a-8473-f50696b06997 service nova] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:32:10.712915 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9965111b-ad8f-422a-8473-f50696b06997 service nova] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:32:10.713351 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9965111b-ad8f-422a-8473-f50696b06997 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:32:10.726165 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9965111b-ad8f-422a-8473-f50696b06997 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:32:10.728901 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9965111b-ad8f-422a-8473-f50696b06997 service nova] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:32:10.743758 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 506/1010] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 08:32:10 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 08:32:13.934867 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6932b2-d502-4391-9b82-91d37fed025a None None] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:32:13.935484 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6932b2-d502-4391-9b82-91d37fed025a None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:32:13.935484 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6932b2-d502-4391-9b82-91d37fed025a None None] PATH_INFO: `/` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:32:13.938037 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 505/1011] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:32:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:32:13.945821 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b47f67-7293-4ae0-a348-c989a24d4c41 None None] REQUEST_METHOD: `POST` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:32:13.946450 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b47f67-7293-4ae0-a348-c989a24d4c41 None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:32:13.946700 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b47f67-7293-4ae0-a348-c989a24d4c41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:32:13.968159 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.auth.core [None req-63b47f67-7293-4ae0-a348-c989a24d4c41 None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:32:13.969508 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.fernet_utils [None req-63b47f67-7293-4ae0-a348-c989a24d4c41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:32:13.979444 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 507/1012] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:32:13 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 08:32:14.029586 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6932b2-d502-4391-9b82-91d37fed025a None None] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:32:14.045037 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6932b2-d502-4391-9b82-91d37fed025a None None] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:32:14.056200 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d297a5b8-55d7-4d4c-aafd-b248e0362d50 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a09bdc2dbac4f9abe450ff121e7dce8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '256f4731060449f1b80067e51e8bec00', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:32:14.056920 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d297a5b8-55d7-4d4c-aafd-b248e0362d50 service nova] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:32:14.057199 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d297a5b8-55d7-4d4c-aafd-b248e0362d50 service nova] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:32:14.057653 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d297a5b8-55d7-4d4c-aafd-b248e0362d50 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:32:14.067870 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d297a5b8-55d7-4d4c-aafd-b248e0362d50 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:32:14.069793 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d297a5b8-55d7-4d4c-aafd-b248e0362d50 service nova] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:32:14.081312 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 506/1013] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 08:32:14 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 08:32:16.604483 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6303b8-24e2-4047-bf51-2085c1a3714b None None] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:32:16.605211 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6303b8-24e2-4047-bf51-2085c1a3714b None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:32:16.605211 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6303b8-24e2-4047-bf51-2085c1a3714b None None] PATH_INFO: `/` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:32:16.605374 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2301150-df67-473d-9699-4520e86a85f0 None None] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:32:16.605374 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2301150-df67-473d-9699-4520e86a85f0 None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:32:16.605834 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2301150-df67-473d-9699-4520e86a85f0 None None] PATH_INFO: `/` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:32:16.606542 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 508/1014] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:32:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:32:16.607135 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 507/1015] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:32:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:32:16.612717 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229a6cb9-9c53-48fa-9646-a9f4ff26d8be None None] REQUEST_METHOD: `POST` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:32:16.613073 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229a6cb9-9c53-48fa-9646-a9f4ff26d8be None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:32:16.613347 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229a6cb9-9c53-48fa-9646-a9f4ff26d8be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:32:16.613628 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03a3afc-91cc-421f-992c-de9274c7d436 None None] REQUEST_METHOD: `POST` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:32:16.613948 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03a3afc-91cc-421f-992c-de9274c7d436 None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:32:16.614202 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03a3afc-91cc-421f-992c-de9274c7d436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:32:16.634841 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.auth.core [None req-229a6cb9-9c53-48fa-9646-a9f4ff26d8be None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:32:16.636066 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.fernet_utils [None req-229a6cb9-9c53-48fa-9646-a9f4ff26d8be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:32:16.637039 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.auth.core [None req-d03a3afc-91cc-421f-992c-de9274c7d436 None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:32:16.638083 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.fernet_utils [None req-d03a3afc-91cc-421f-992c-de9274c7d436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:32:16.645720 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 509/1016] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:32:16 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 08:32:16.647103 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 508/1017] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:32:16 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 08:32:16.693412 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229a6cb9-9c53-48fa-9646-a9f4ff26d8be None None] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:32:16.704949 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229a6cb9-9c53-48fa-9646-a9f4ff26d8be None None] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:32:16.708545 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dabf8c-ac8f-4e60-8330-5be49b6eecb9 None None] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:32:16.709099 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dabf8c-ac8f-4e60-8330-5be49b6eecb9 None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:32:16.709601 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dabf8c-ac8f-4e60-8330-5be49b6eecb9 None None] PATH_INFO: `/` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:32:16.710130 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba2c2a8-3657-4586-8994-74001c501ee1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a09bdc2dbac4f9abe450ff121e7dce8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '256f4731060449f1b80067e51e8bec00', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:32:16.710781 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba2c2a8-3657-4586-8994-74001c501ee1 service nova] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:32:16.710976 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 509/1018] 10.222.0.62 () {54 vars in 962 bytes} [Fri May 27 08:32:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 08:32:16.711092 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba2c2a8-3657-4586-8994-74001c501ee1 service nova] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:32:16.711333 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba2c2a8-3657-4586-8994-74001c501ee1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:32:16.716171 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eb7852-c29e-4278-9080-d753d7dd73eb None None] REQUEST_METHOD: `POST` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:32:16.716469 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eb7852-c29e-4278-9080-d753d7dd73eb None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:32:16.716789 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eb7852-c29e-4278-9080-d753d7dd73eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:32:16.721751 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba2c2a8-3657-4586-8994-74001c501ee1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:32:16.723543 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba2c2a8-3657-4586-8994-74001c501ee1 service nova] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:32:16.734863 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 510/1019] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 08:32:16 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 08:32:16.757710 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.auth.core [None req-09eb7852-c29e-4278-9080-d753d7dd73eb None None] MFA Rules not processed for user `2af5ebcf47654d08881584431b199416`. Rule list: `[]` (Enabled: `True`). {{(pid=87172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:32:16.758938 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.fernet_utils [None req-09eb7852-c29e-4278-9080-d753d7dd73eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:32:16.852763 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 510/1020] 10.222.0.62 () {58 vars in 1059 bytes} [Fri May 27 08:32:16 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 08:32:16.859984 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba2c2a8-3657-4586-8994-74001c501ee1 service nova] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:32:16.875462 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba2c2a8-3657-4586-8994-74001c501ee1 service nova] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:32:16.879708 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749011c9-f07a-4b5b-9045-518f486a12b0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af5ebcf47654d08881584431b199416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '256f4731060449f1b80067e51e8bec00', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:32:16.880374 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749011c9-f07a-4b5b-9045-518f486a12b0 service glance] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:32:16.880706 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749011c9-f07a-4b5b-9045-518f486a12b0 service glance] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:32:16.880968 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749011c9-f07a-4b5b-9045-518f486a12b0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:32:16.892499 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749011c9-f07a-4b5b-9045-518f486a12b0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:32:16.894196 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749011c9-f07a-4b5b-9045-518f486a12b0 service glance] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:32:16.907606 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 511/1021] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 08:32:16 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 08:32:19.213747 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee29cdb-75e5-4afe-a421-eeea5d945d82 None None] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:32:19.214377 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee29cdb-75e5-4afe-a421-eeea5d945d82 None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:32:19.214377 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee29cdb-75e5-4afe-a421-eeea5d945d82 None None] PATH_INFO: `/` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:32:19.218606 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 511/1022] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:32:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:32:19.221876 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244e530e-fd34-41b6-a492-d91f61172c81 None None] REQUEST_METHOD: `POST` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:32:19.222389 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244e530e-fd34-41b6-a492-d91f61172c81 None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:32:19.222619 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244e530e-fd34-41b6-a492-d91f61172c81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:32:19.228983 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=98 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:32:19.245394 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.auth.core [None req-244e530e-fd34-41b6-a492-d91f61172c81 None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:32:19.246731 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.fernet_utils [None req-244e530e-fd34-41b6-a492-d91f61172c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:32:19.268651 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 512/1023] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:32:19 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 08:32:19.391268 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee29cdb-75e5-4afe-a421-eeea5d945d82 None None] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:32:19.391268 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee29cdb-75e5-4afe-a421-eeea5d945d82 None None] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:32:19.391268 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ea6b81-987b-4c66-9cd1-c356b35ddad9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a09bdc2dbac4f9abe450ff121e7dce8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '256f4731060449f1b80067e51e8bec00', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:32:19.391268 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ea6b81-987b-4c66-9cd1-c356b35ddad9 service nova] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:32:19.392422 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ea6b81-987b-4c66-9cd1-c356b35ddad9 service nova] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:32:19.392422 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ea6b81-987b-4c66-9cd1-c356b35ddad9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:32:19.392422 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ea6b81-987b-4c66-9cd1-c356b35ddad9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:32:19.392422 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ea6b81-987b-4c66-9cd1-c356b35ddad9 service nova] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:32:19.397295 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 512/1024] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 08:32:19 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 08:32:29.240667 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=2 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:32:29.374472 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=50 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:32:32.677516 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0399f777-b3ca-4163-9228-afdd5627f284 None None] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:32:32.678125 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0399f777-b3ca-4163-9228-afdd5627f284 None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:32:32.678125 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0399f777-b3ca-4163-9228-afdd5627f284 None None] PATH_INFO: `/` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:32:32.679487 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 513/1025] 10.222.0.62 () {54 vars in 918 bytes} [Fri May 27 08:32:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:32:32.685155 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b3ba14-dce5-4525-9bc2-b7e7f68f2f15 None None] REQUEST_METHOD: `POST` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:32:32.686630 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b3ba14-dce5-4525-9bc2-b7e7f68f2f15 None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:32:32.686630 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b3ba14-dce5-4525-9bc2-b7e7f68f2f15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:32:32.706322 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.auth.core [None req-99b3ba14-dce5-4525-9bc2-b7e7f68f2f15 None None] MFA Rules not processed for user `7b12a598052a4b749edb0c021d99b951`. Rule list: `[]` (Enabled: `True`). {{(pid=87172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:32:32.707592 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.fernet_utils [None req-99b3ba14-dce5-4525-9bc2-b7e7f68f2f15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:32:32.716274 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 513/1026] 10.222.0.62 () {58 vars in 1015 bytes} [Fri May 27 08:32:32 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 08:32:32.731773 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cce661-bd10-43dd-820d-fc724a81c3bb None None] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:32:32.732058 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cce661-bd10-43dd-820d-fc724a81c3bb None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:32:32.732334 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cce661-bd10-43dd-820d-fc724a81c3bb None None] PATH_INFO: `/` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:32:32.733914 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 514/1027] 10.222.0.62 () {54 vars in 918 bytes} [Fri May 27 08:32:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:32:32.739373 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae00482-2f6e-4e84-bda7-7b1361dcc475 None None] REQUEST_METHOD: `POST` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:32:32.739618 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae00482-2f6e-4e84-bda7-7b1361dcc475 None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:32:32.739897 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae00482-2f6e-4e84-bda7-7b1361dcc475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:32:32.759318 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.auth.core [None req-2ae00482-2f6e-4e84-bda7-7b1361dcc475 None None] MFA Rules not processed for user `3a09bdc2dbac4f9abe450ff121e7dce8`. Rule list: `[]` (Enabled: `True`). {{(pid=87172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:32:32.760562 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.fernet_utils [None req-2ae00482-2f6e-4e84-bda7-7b1361dcc475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:32:32.770242 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 514/1028] 10.222.0.62 () {58 vars in 1015 bytes} [Fri May 27 08:32:32 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 08:32:35.616959 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2871384-6b52-4b37-bdef-3a9de8287c74 None None] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:32:35.617528 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2871384-6b52-4b37-bdef-3a9de8287c74 None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:32:35.617528 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2871384-6b52-4b37-bdef-3a9de8287c74 None None] PATH_INFO: `/` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:32:35.618867 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 515/1029] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 08:32:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:32:35.625097 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add995fb-0a13-4ab9-b59f-e3c10d5b1553 None None] REQUEST_METHOD: `POST` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:32:35.625593 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add995fb-0a13-4ab9-b59f-e3c10d5b1553 None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:32:35.625701 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add995fb-0a13-4ab9-b59f-e3c10d5b1553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:32:35.644550 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.auth.core [None req-add995fb-0a13-4ab9-b59f-e3c10d5b1553 None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:32:35.645791 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.fernet_utils [None req-add995fb-0a13-4ab9-b59f-e3c10d5b1553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:32:35.653543 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 515/1030] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 08:32:35 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 08:32:35.699570 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2871384-6b52-4b37-bdef-3a9de8287c74 None None] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:32:35.715437 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2871384-6b52-4b37-bdef-3a9de8287c74 None None] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:32:35.721385 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d2c56c-e6fb-4c2b-a485-1f22d2c82923 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a09bdc2dbac4f9abe450ff121e7dce8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '256f4731060449f1b80067e51e8bec00', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:32:35.722136 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d2c56c-e6fb-4c2b-a485-1f22d2c82923 service nova] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:32:35.722474 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d2c56c-e6fb-4c2b-a485-1f22d2c82923 service nova] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:32:35.722795 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d2c56c-e6fb-4c2b-a485-1f22d2c82923 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:32:35.733044 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d2c56c-e6fb-4c2b-a485-1f22d2c82923 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:32:35.734823 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d2c56c-e6fb-4c2b-a485-1f22d2c82923 service nova] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:32:35.745163 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 516/1031] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 08:32:35 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 08:32:36.769100 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f62964c-57d5-4888-847b-3763f4566249 None None] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:32:36.769664 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f62964c-57d5-4888-847b-3763f4566249 None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:32:36.769664 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f62964c-57d5-4888-847b-3763f4566249 None None] PATH_INFO: `/` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:32:36.770941 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 516/1032] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 27 08:32:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:32:36.775745 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62df66f-9226-4e71-b735-163edd16c204 None None] REQUEST_METHOD: `POST` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:32:36.776184 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62df66f-9226-4e71-b735-163edd16c204 None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:32:36.776292 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62df66f-9226-4e71-b735-163edd16c204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:32:36.795289 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.auth.core [None req-b62df66f-9226-4e71-b735-163edd16c204 None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:32:36.796487 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.fernet_utils [None req-b62df66f-9226-4e71-b735-163edd16c204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:32:36.805248 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 517/1033] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 27 08:32:36 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 08:32:37.014953 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f62964c-57d5-4888-847b-3763f4566249 None None] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:32:37.031260 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f62964c-57d5-4888-847b-3763f4566249 None None] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:32:37.036296 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea85fb2-5068-4335-b082-01ae1998c6a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a09bdc2dbac4f9abe450ff121e7dce8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '256f4731060449f1b80067e51e8bec00', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:32:37.036973 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea85fb2-5068-4335-b082-01ae1998c6a9 service nova] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:32:37.037262 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea85fb2-5068-4335-b082-01ae1998c6a9 service nova] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:32:37.037524 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea85fb2-5068-4335-b082-01ae1998c6a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:32:37.045935 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea85fb2-5068-4335-b082-01ae1998c6a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:32:37.047524 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea85fb2-5068-4335-b082-01ae1998c6a9 service nova] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:32:37.056806 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 517/1034] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 08:32:37 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 08:32:38.024311 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564f9e25-bdb8-4983-b8dc-eda209ee959e None None] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:32:38.024919 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564f9e25-bdb8-4983-b8dc-eda209ee959e None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:32:38.024919 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564f9e25-bdb8-4983-b8dc-eda209ee959e None None] PATH_INFO: `/` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:32:38.026333 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 518/1035] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 27 08:32:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:32:38.032090 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb9c191-307e-47b1-b8c9-c586571e017c None None] REQUEST_METHOD: `POST` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:32:38.032580 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb9c191-307e-47b1-b8c9-c586571e017c None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:32:38.032710 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb9c191-307e-47b1-b8c9-c586571e017c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:32:38.050930 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.auth.core [None req-3cb9c191-307e-47b1-b8c9-c586571e017c None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:32:38.052147 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.fernet_utils [None req-3cb9c191-307e-47b1-b8c9-c586571e017c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:32:38.060010 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 518/1036] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 27 08:32:38 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 08:32:38.218302 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564f9e25-bdb8-4983-b8dc-eda209ee959e None None] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:32:38.233181 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564f9e25-bdb8-4983-b8dc-eda209ee959e None None] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:32:38.238202 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddcb129-8512-4fdc-b584-1a385862913c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a09bdc2dbac4f9abe450ff121e7dce8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '256f4731060449f1b80067e51e8bec00', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:32:38.238839 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddcb129-8512-4fdc-b584-1a385862913c service nova] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:32:38.239132 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddcb129-8512-4fdc-b584-1a385862913c service nova] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:32:38.239411 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddcb129-8512-4fdc-b584-1a385862913c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:32:38.247644 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddcb129-8512-4fdc-b584-1a385862913c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:32:38.249994 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddcb129-8512-4fdc-b584-1a385862913c service nova] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:32:38.259397 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 519/1037] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 08:32:38 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 08:32:39.251245 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f8a205-cbc0-4168-b816-059466ae74e1 None None] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:32:39.251821 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f8a205-cbc0-4168-b816-059466ae74e1 None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:32:39.251821 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f8a205-cbc0-4168-b816-059466ae74e1 None None] PATH_INFO: `/` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:32:39.253209 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 519/1038] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 27 08:32:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:32:39.258157 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fdd21d-18ed-4762-a500-7ef4c5ec2348 None None] REQUEST_METHOD: `POST` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:32:39.258608 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fdd21d-18ed-4762-a500-7ef4c5ec2348 None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:32:39.258708 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fdd21d-18ed-4762-a500-7ef4c5ec2348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:32:39.278215 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.auth.core [None req-d5fdd21d-18ed-4762-a500-7ef4c5ec2348 None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:32:39.279739 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.fernet_utils [None req-d5fdd21d-18ed-4762-a500-7ef4c5ec2348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:32:39.287589 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 520/1039] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 27 08:32:39 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 08:32:39.443442 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f8a205-cbc0-4168-b816-059466ae74e1 None None] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:32:39.457313 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f8a205-cbc0-4168-b816-059466ae74e1 None None] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:32:39.462827 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a841aa4e-e754-4763-a0ec-f7b97b74c5c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a09bdc2dbac4f9abe450ff121e7dce8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '256f4731060449f1b80067e51e8bec00', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:32:39.462948 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a841aa4e-e754-4763-a0ec-f7b97b74c5c6 service nova] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:32:39.463228 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a841aa4e-e754-4763-a0ec-f7b97b74c5c6 service nova] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:32:39.463512 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a841aa4e-e754-4763-a0ec-f7b97b74c5c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:32:39.471934 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a841aa4e-e754-4763-a0ec-f7b97b74c5c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:32:39.473551 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a841aa4e-e754-4763-a0ec-f7b97b74c5c6 service nova] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:32:39.482913 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 520/1040] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 08:32:39 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 08:32:40.411626 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220525b8-ced8-4116-ad47-793e09a55eba None None] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:32:40.412269 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220525b8-ced8-4116-ad47-793e09a55eba None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:32:40.412269 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220525b8-ced8-4116-ad47-793e09a55eba None None] PATH_INFO: `/` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:32:40.413607 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 521/1041] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 27 08:32:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:32:40.418580 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94695864-dca2-4e25-b9f3-9f7a6cd0999c None None] REQUEST_METHOD: `POST` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:32:40.419000 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94695864-dca2-4e25-b9f3-9f7a6cd0999c None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:32:40.419136 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94695864-dca2-4e25-b9f3-9f7a6cd0999c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:32:40.437237 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.auth.core [None req-94695864-dca2-4e25-b9f3-9f7a6cd0999c None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:32:40.438430 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.fernet_utils [None req-94695864-dca2-4e25-b9f3-9f7a6cd0999c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:32:40.446493 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 521/1042] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 27 08:32:40 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 08:32:40.599909 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220525b8-ced8-4116-ad47-793e09a55eba None None] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:32:40.613352 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220525b8-ced8-4116-ad47-793e09a55eba None None] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:32:40.618310 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2afde0-3977-4bca-b264-b3542d662895 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a09bdc2dbac4f9abe450ff121e7dce8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '256f4731060449f1b80067e51e8bec00', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:32:40.618945 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2afde0-3977-4bca-b264-b3542d662895 service nova] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:32:40.619232 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2afde0-3977-4bca-b264-b3542d662895 service nova] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:32:40.619512 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2afde0-3977-4bca-b264-b3542d662895 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:32:40.628149 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2afde0-3977-4bca-b264-b3542d662895 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:32:40.629790 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2afde0-3977-4bca-b264-b3542d662895 service nova] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:32:40.643263 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 522/1043] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 08:32:40 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 08:32:41.531920 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7b055e-9d1c-490c-bd9b-0ad4aba5abc9 None None] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:32:41.532483 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7b055e-9d1c-490c-bd9b-0ad4aba5abc9 None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:32:41.532483 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7b055e-9d1c-490c-bd9b-0ad4aba5abc9 None None] PATH_INFO: `/` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:32:41.533961 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 522/1044] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 27 08:32:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:32:41.539672 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbd3042-d332-4a27-858c-07919ba168cc None None] REQUEST_METHOD: `POST` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:32:41.540242 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbd3042-d332-4a27-858c-07919ba168cc None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:32:41.540242 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbd3042-d332-4a27-858c-07919ba168cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:32:41.558875 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.auth.core [None req-2dbd3042-d332-4a27-858c-07919ba168cc None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:32:41.560079 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.fernet_utils [None req-2dbd3042-d332-4a27-858c-07919ba168cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:32:41.569808 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 523/1045] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 27 08:32:41 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 08:32:41.727332 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7b055e-9d1c-490c-bd9b-0ad4aba5abc9 None None] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:32:41.740922 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7b055e-9d1c-490c-bd9b-0ad4aba5abc9 None None] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:32:41.746469 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c227ed3e-9688-4f57-9c75-67d84b2c28b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a09bdc2dbac4f9abe450ff121e7dce8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '256f4731060449f1b80067e51e8bec00', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:32:41.747117 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c227ed3e-9688-4f57-9c75-67d84b2c28b9 service nova] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:32:41.747402 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c227ed3e-9688-4f57-9c75-67d84b2c28b9 service nova] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:32:41.748321 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c227ed3e-9688-4f57-9c75-67d84b2c28b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:32:41.757846 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c227ed3e-9688-4f57-9c75-67d84b2c28b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:32:41.759499 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c227ed3e-9688-4f57-9c75-67d84b2c28b9 service nova] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:32:41.770369 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 523/1046] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 08:32:41 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 08:32:42.640056 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692003bf-6a13-4d44-8ed5-a5385dd12980 None None] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:32:42.640770 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692003bf-6a13-4d44-8ed5-a5385dd12980 None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:32:42.640770 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692003bf-6a13-4d44-8ed5-a5385dd12980 None None] PATH_INFO: `/` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:32:42.642092 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 524/1047] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 27 08:32:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:32:42.648733 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a37546b-fdd7-4137-b0ac-78f7a1dc2bfb None None] REQUEST_METHOD: `POST` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:32:42.649113 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a37546b-fdd7-4137-b0ac-78f7a1dc2bfb None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:32:42.649377 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a37546b-fdd7-4137-b0ac-78f7a1dc2bfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:32:42.669186 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.auth.core [None req-0a37546b-fdd7-4137-b0ac-78f7a1dc2bfb None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:32:42.670912 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.fernet_utils [None req-0a37546b-fdd7-4137-b0ac-78f7a1dc2bfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:32:42.678923 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 524/1048] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 27 08:32:42 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 08:32:42.837600 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692003bf-6a13-4d44-8ed5-a5385dd12980 None None] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:32:42.852307 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692003bf-6a13-4d44-8ed5-a5385dd12980 None None] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:32:42.857850 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45396233-0f54-451b-bafb-540860b5d324 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a09bdc2dbac4f9abe450ff121e7dce8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '256f4731060449f1b80067e51e8bec00', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:32:42.862981 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45396233-0f54-451b-bafb-540860b5d324 service nova] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:32:42.862981 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45396233-0f54-451b-bafb-540860b5d324 service nova] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:32:42.862981 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45396233-0f54-451b-bafb-540860b5d324 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:32:42.868438 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45396233-0f54-451b-bafb-540860b5d324 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:32:42.870129 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45396233-0f54-451b-bafb-540860b5d324 service nova] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:32:42.880625 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 525/1049] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 08:32:42 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 08:32:43.759059 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725227d5-971b-4c8a-b1f0-88382907f093 None None] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:32:43.759569 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725227d5-971b-4c8a-b1f0-88382907f093 None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:32:43.759569 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725227d5-971b-4c8a-b1f0-88382907f093 None None] PATH_INFO: `/` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:32:43.761072 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 525/1050] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 27 08:32:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:32:43.766920 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e80dfa-2081-4018-888e-161e4c3d0513 None None] REQUEST_METHOD: `POST` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:32:43.767370 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e80dfa-2081-4018-888e-161e4c3d0513 None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:32:43.767518 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e80dfa-2081-4018-888e-161e4c3d0513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:32:43.785821 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.auth.core [None req-91e80dfa-2081-4018-888e-161e4c3d0513 None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:32:43.787027 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.fernet_utils [None req-91e80dfa-2081-4018-888e-161e4c3d0513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:32:43.795371 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 526/1051] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 27 08:32:43 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 08:32:43.948404 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725227d5-971b-4c8a-b1f0-88382907f093 None None] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:32:43.964324 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725227d5-971b-4c8a-b1f0-88382907f093 None None] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:32:43.969821 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d9bc40-0303-4a45-af7a-abca90070b57 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a09bdc2dbac4f9abe450ff121e7dce8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '256f4731060449f1b80067e51e8bec00', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:32:43.970463 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d9bc40-0303-4a45-af7a-abca90070b57 service nova] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:32:43.970745 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d9bc40-0303-4a45-af7a-abca90070b57 service nova] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:32:43.971020 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d9bc40-0303-4a45-af7a-abca90070b57 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:32:43.979667 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d9bc40-0303-4a45-af7a-abca90070b57 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:32:43.981297 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d9bc40-0303-4a45-af7a-abca90070b57 service nova] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:32:43.991770 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 526/1052] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 08:32:43 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 08:32:44.876689 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead661e4-6e52-479b-9ab2-9957611fcd53 None None] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:32:44.877224 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead661e4-6e52-479b-9ab2-9957611fcd53 None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:32:44.877224 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead661e4-6e52-479b-9ab2-9957611fcd53 None None] PATH_INFO: `/` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:32:44.878607 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 527/1053] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 27 08:32:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:32:44.883698 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb129ea-fd45-4a2c-bc42-569e5706ea5d None None] REQUEST_METHOD: `POST` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:32:44.884120 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb129ea-fd45-4a2c-bc42-569e5706ea5d None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:32:44.884266 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb129ea-fd45-4a2c-bc42-569e5706ea5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:32:44.903301 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.auth.core [None req-1bb129ea-fd45-4a2c-bc42-569e5706ea5d None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:32:44.904986 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.fernet_utils [None req-1bb129ea-fd45-4a2c-bc42-569e5706ea5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:32:44.913683 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 527/1054] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 27 08:32:44 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 08:32:45.068154 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead661e4-6e52-479b-9ab2-9957611fcd53 None None] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:32:45.082069 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead661e4-6e52-479b-9ab2-9957611fcd53 None None] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:32:45.087186 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f49c672-7a80-4d1a-b591-41140d570253 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a09bdc2dbac4f9abe450ff121e7dce8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '256f4731060449f1b80067e51e8bec00', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:32:45.087829 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f49c672-7a80-4d1a-b591-41140d570253 service nova] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:32:45.088114 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f49c672-7a80-4d1a-b591-41140d570253 service nova] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:32:45.088394 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f49c672-7a80-4d1a-b591-41140d570253 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:32:45.097614 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f49c672-7a80-4d1a-b591-41140d570253 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:32:45.099218 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f49c672-7a80-4d1a-b591-41140d570253 service nova] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:32:45.109465 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 528/1055] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 08:32:45 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 08:32:47.288333 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70ec4bb-7a8c-49cc-9a40-3fbcb77f953f None None] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:32:47.288910 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70ec4bb-7a8c-49cc-9a40-3fbcb77f953f None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:32:47.288910 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70ec4bb-7a8c-49cc-9a40-3fbcb77f953f None None] PATH_INFO: `/` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:32:47.290300 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 528/1056] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 08:32:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:32:47.295795 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f0a9bf-c3ac-4bf1-b9ed-add930cabf6c None None] REQUEST_METHOD: `POST` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:32:47.296257 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f0a9bf-c3ac-4bf1-b9ed-add930cabf6c None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:32:47.296356 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f0a9bf-c3ac-4bf1-b9ed-add930cabf6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:32:47.314987 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.auth.core [None req-07f0a9bf-c3ac-4bf1-b9ed-add930cabf6c None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:32:47.316200 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.fernet_utils [None req-07f0a9bf-c3ac-4bf1-b9ed-add930cabf6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:32:47.324065 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 529/1057] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 08:32:47 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 08:32:47.364447 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70ec4bb-7a8c-49cc-9a40-3fbcb77f953f None None] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:32:47.376276 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70ec4bb-7a8c-49cc-9a40-3fbcb77f953f None None] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:32:47.379991 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0e577f-dd91-4aa4-a611-0fe0aee05be8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56934ba9afb741679e0573167d6825f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '256f4731060449f1b80067e51e8bec00', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:32:47.380675 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0e577f-dd91-4aa4-a611-0fe0aee05be8 service neutron] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:32:47.380967 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0e577f-dd91-4aa4-a611-0fe0aee05be8 service neutron] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:32:47.381248 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0e577f-dd91-4aa4-a611-0fe0aee05be8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:32:47.391615 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0e577f-dd91-4aa4-a611-0fe0aee05be8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:32:47.393105 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0e577f-dd91-4aa4-a611-0fe0aee05be8 service neutron] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:32:47.402910 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 529/1058] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 08:32:47 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 08:32:49.901872 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122a2d88-9d4d-4dc2-969a-83ebed19fe08 None None] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:32:49.902469 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122a2d88-9d4d-4dc2-969a-83ebed19fe08 None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:32:49.902469 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122a2d88-9d4d-4dc2-969a-83ebed19fe08 None None] PATH_INFO: `/` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:32:49.904140 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 530/1059] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 08:32:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 08:32:49.910191 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbddad7c-ed23-4ce8-84d8-faf6fec73256 None None] REQUEST_METHOD: `POST` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:32:49.910739 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbddad7c-ed23-4ce8-84d8-faf6fec73256 None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:32:49.910848 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbddad7c-ed23-4ce8-84d8-faf6fec73256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:32:49.933631 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.auth.core [None req-fbddad7c-ed23-4ce8-84d8-faf6fec73256 None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:32:49.935728 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.fernet_utils [None req-fbddad7c-ed23-4ce8-84d8-faf6fec73256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:32:49.943924 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 530/1060] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 08:32:49 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 08:32:49.997044 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616af98f-7113-4c93-9d96-1c42d31056f0 None None] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:32:49.998025 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616af98f-7113-4c93-9d96-1c42d31056f0 None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:32:49.998451 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616af98f-7113-4c93-9d96-1c42d31056f0 None None] PATH_INFO: `/` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:32:49.999825 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 531/1061] 10.222.0.62 () {54 vars in 964 bytes} [Fri May 27 08:32:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:32:50.006270 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3882ae9a-b25b-4994-b438-6fa5fe391a28 None None] REQUEST_METHOD: `POST` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:32:50.006559 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3882ae9a-b25b-4994-b438-6fa5fe391a28 None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:32:50.006839 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3882ae9a-b25b-4994-b438-6fa5fe391a28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:32:50.024895 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.auth.core [None req-3882ae9a-b25b-4994-b438-6fa5fe391a28 None None] MFA Rules not processed for user `56934ba9afb741679e0573167d6825f5`. Rule list: `[]` (Enabled: `True`). {{(pid=87172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:32:50.026099 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.fernet_utils [None req-3882ae9a-b25b-4994-b438-6fa5fe391a28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:32:50.032991 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 531/1062] 10.222.0.62 () {58 vars in 1061 bytes} [Fri May 27 08:32:50 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 08:32:50.041878 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616af98f-7113-4c93-9d96-1c42d31056f0 None None] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:32:50.053413 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616af98f-7113-4c93-9d96-1c42d31056f0 None None] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:32:50.056962 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18aa6f9e-1c30-4a31-8b7e-5a6df81e5035 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56934ba9afb741679e0573167d6825f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '256f4731060449f1b80067e51e8bec00', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:32:50.057602 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aa6f9e-1c30-4a31-8b7e-5a6df81e5035 service neutron] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:32:50.057885 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aa6f9e-1c30-4a31-8b7e-5a6df81e5035 service neutron] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:32:50.058159 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aa6f9e-1c30-4a31-8b7e-5a6df81e5035 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:32:50.070739 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18aa6f9e-1c30-4a31-8b7e-5a6df81e5035 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:32:50.072256 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18aa6f9e-1c30-4a31-8b7e-5a6df81e5035 service neutron] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:32:50.083470 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 532/1063] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 08:32:50 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 08:32:53.262190 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbba7fb9-beb3-40a6-ba25-efffb439e8fa None None] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:32:53.262825 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbba7fb9-beb3-40a6-ba25-efffb439e8fa None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:32:53.262825 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbba7fb9-beb3-40a6-ba25-efffb439e8fa None None] PATH_INFO: `/` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:32:53.264388 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 532/1064] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 08:32:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:32:53.269693 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba79c4ad-44b6-43bf-b248-a2b469dc212a None None] REQUEST_METHOD: `POST` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:32:53.270110 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba79c4ad-44b6-43bf-b248-a2b469dc212a None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:32:53.270265 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba79c4ad-44b6-43bf-b248-a2b469dc212a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:32:53.289819 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.auth.core [None req-ba79c4ad-44b6-43bf-b248-a2b469dc212a None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:32:53.291043 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.fernet_utils [None req-ba79c4ad-44b6-43bf-b248-a2b469dc212a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:32:53.299897 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 533/1065] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 08:32:53 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 08:32:53.340328 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbba7fb9-beb3-40a6-ba25-efffb439e8fa None None] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:32:53.352012 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbba7fb9-beb3-40a6-ba25-efffb439e8fa None None] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:32:53.355501 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586f1a55-7a7b-4b16-94af-4d279f66f8bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56934ba9afb741679e0573167d6825f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '256f4731060449f1b80067e51e8bec00', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:32:53.356138 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586f1a55-7a7b-4b16-94af-4d279f66f8bd service neutron] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:32:53.357298 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586f1a55-7a7b-4b16-94af-4d279f66f8bd service neutron] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:32:53.357583 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586f1a55-7a7b-4b16-94af-4d279f66f8bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:32:53.366868 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586f1a55-7a7b-4b16-94af-4d279f66f8bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:32:53.368309 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586f1a55-7a7b-4b16-94af-4d279f66f8bd service neutron] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:32:53.377994 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 533/1066] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 08:32:53 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 08:32:55.906875 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7930e8-8268-46c2-a2cc-c97499eacdf8 None None] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:32:55.907456 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7930e8-8268-46c2-a2cc-c97499eacdf8 None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:32:55.907456 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7930e8-8268-46c2-a2cc-c97499eacdf8 None None] PATH_INFO: `/` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:32:55.908947 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 534/1067] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 08:32:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:32:55.914377 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb20cf92-53e6-4129-83ab-ca48033948e0 None None] REQUEST_METHOD: `POST` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:32:55.914822 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb20cf92-53e6-4129-83ab-ca48033948e0 None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:32:55.914925 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb20cf92-53e6-4129-83ab-ca48033948e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:32:55.932785 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.auth.core [None req-cb20cf92-53e6-4129-83ab-ca48033948e0 None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:32:55.934024 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.fernet_utils [None req-cb20cf92-53e6-4129-83ab-ca48033948e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:32:55.942361 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 534/1068] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 08:32:55 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 08:32:55.985425 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7930e8-8268-46c2-a2cc-c97499eacdf8 None None] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:32:55.996562 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7930e8-8268-46c2-a2cc-c97499eacdf8 None None] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:32:56.000387 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14c112e-0c68-43d5-97fd-6c3ac298d8f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56934ba9afb741679e0573167d6825f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '256f4731060449f1b80067e51e8bec00', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:32:56.001071 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14c112e-0c68-43d5-97fd-6c3ac298d8f0 service neutron] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:32:56.001355 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14c112e-0c68-43d5-97fd-6c3ac298d8f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:32:56.001631 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14c112e-0c68-43d5-97fd-6c3ac298d8f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:32:56.011320 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14c112e-0c68-43d5-97fd-6c3ac298d8f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:32:56.013489 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14c112e-0c68-43d5-97fd-6c3ac298d8f0 service neutron] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:32:56.023243 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 535/1069] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 08:32:55 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 08:32:58.463053 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66de69f6-5647-4223-929b-0be9cdde021f None None] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:32:58.463625 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66de69f6-5647-4223-929b-0be9cdde021f None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:32:58.463625 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66de69f6-5647-4223-929b-0be9cdde021f None None] PATH_INFO: `/` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:32:58.464989 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 535/1070] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 08:32:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:32:58.471078 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7498b72e-6c4b-4921-b332-10c6944b0898 None None] REQUEST_METHOD: `POST` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:32:58.471542 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7498b72e-6c4b-4921-b332-10c6944b0898 None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:32:58.471684 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7498b72e-6c4b-4921-b332-10c6944b0898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:32:58.490414 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.auth.core [None req-7498b72e-6c4b-4921-b332-10c6944b0898 None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:32:58.491870 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.fernet_utils [None req-7498b72e-6c4b-4921-b332-10c6944b0898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:32:58.500933 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 536/1071] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 08:32:58 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 08:32:58.541318 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66de69f6-5647-4223-929b-0be9cdde021f None None] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:32:58.552485 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66de69f6-5647-4223-929b-0be9cdde021f None None] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:32:58.556527 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a47f29-1394-4d55-9b69-943441475d0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56934ba9afb741679e0573167d6825f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '256f4731060449f1b80067e51e8bec00', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:32:58.557200 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a47f29-1394-4d55-9b69-943441475d0c service neutron] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:32:58.557477 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a47f29-1394-4d55-9b69-943441475d0c service neutron] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:32:58.557751 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a47f29-1394-4d55-9b69-943441475d0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:32:58.567761 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a47f29-1394-4d55-9b69-943441475d0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:32:58.569231 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a47f29-1394-4d55-9b69-943441475d0c service neutron] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:32:58.578969 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 536/1072] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 08:32:58 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 08:33:01.054401 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2272982b-9e97-4666-8c86-a2c077947b27 None None] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:33:01.054936 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2272982b-9e97-4666-8c86-a2c077947b27 None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:33:01.055046 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2272982b-9e97-4666-8c86-a2c077947b27 None None] PATH_INFO: `/` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:33:01.056375 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 537/1073] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 08:33:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:33:01.063220 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d16a2d-b156-4d5f-848d-a8916ee4f7da None None] REQUEST_METHOD: `POST` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:33:01.063706 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d16a2d-b156-4d5f-848d-a8916ee4f7da None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:33:01.064197 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d16a2d-b156-4d5f-848d-a8916ee4f7da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:33:01.074535 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=73 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:33:01.091702 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.auth.core [None req-73d16a2d-b156-4d5f-848d-a8916ee4f7da None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:33:01.093554 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.fernet_utils [None req-73d16a2d-b156-4d5f-848d-a8916ee4f7da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:33:01.101577 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 537/1074] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 08:33:01 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 08:33:01.142636 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2272982b-9e97-4666-8c86-a2c077947b27 None None] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:33:01.148071 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=64 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:33:01.156163 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2272982b-9e97-4666-8c86-a2c077947b27 None None] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:33:01.159689 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3313e00-2b4e-4b81-8461-93c6e82829fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56934ba9afb741679e0573167d6825f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '256f4731060449f1b80067e51e8bec00', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:33:01.160364 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3313e00-2b4e-4b81-8461-93c6e82829fb service neutron] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:33:01.160691 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3313e00-2b4e-4b81-8461-93c6e82829fb service neutron] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:33:01.160981 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3313e00-2b4e-4b81-8461-93c6e82829fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:33:01.171036 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3313e00-2b4e-4b81-8461-93c6e82829fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:33:01.172457 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3313e00-2b4e-4b81-8461-93c6e82829fb service neutron] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:33:01.182147 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 538/1075] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 08:33:01 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 08:33:03.701968 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1585ed9-83e3-4502-b6de-e6ac3d48a0e2 None None] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:33:03.702502 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1585ed9-83e3-4502-b6de-e6ac3d48a0e2 None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:33:03.702502 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1585ed9-83e3-4502-b6de-e6ac3d48a0e2 None None] PATH_INFO: `/` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:33:03.703888 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 538/1076] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 08:33:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:33:03.709667 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073c3616-1d60-47c3-9043-edb201abf158 None None] REQUEST_METHOD: `POST` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:33:03.710178 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073c3616-1d60-47c3-9043-edb201abf158 None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:33:03.710310 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073c3616-1d60-47c3-9043-edb201abf158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:33:03.727957 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.auth.core [None req-073c3616-1d60-47c3-9043-edb201abf158 None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:33:03.729292 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.fernet_utils [None req-073c3616-1d60-47c3-9043-edb201abf158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:33:03.737504 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 539/1077] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 08:33:03 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 08:33:03.778534 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1585ed9-83e3-4502-b6de-e6ac3d48a0e2 None None] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:33:03.789511 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1585ed9-83e3-4502-b6de-e6ac3d48a0e2 None None] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:33:03.792952 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a785900-95ff-4d88-88e2-0efcdf914c63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56934ba9afb741679e0573167d6825f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '256f4731060449f1b80067e51e8bec00', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:33:03.793617 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a785900-95ff-4d88-88e2-0efcdf914c63 service neutron] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:33:03.793893 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a785900-95ff-4d88-88e2-0efcdf914c63 service neutron] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:33:03.794165 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a785900-95ff-4d88-88e2-0efcdf914c63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:33:03.802916 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a785900-95ff-4d88-88e2-0efcdf914c63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:33:03.804336 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a785900-95ff-4d88-88e2-0efcdf914c63 service neutron] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:33:03.814972 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 539/1078] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 08:33:03 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 08:33:06.206654 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1552ba-cebe-453c-9f99-e254bb84377f None None] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:33:06.207225 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1552ba-cebe-453c-9f99-e254bb84377f None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:33:06.207225 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1552ba-cebe-453c-9f99-e254bb84377f None None] PATH_INFO: `/` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:33:06.208639 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 540/1079] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 08:33:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:33:06.214121 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ac6cc5-3e81-4461-8bdb-6b5aa87bc4f2 None None] REQUEST_METHOD: `POST` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:33:06.214520 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ac6cc5-3e81-4461-8bdb-6b5aa87bc4f2 None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:33:06.214688 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ac6cc5-3e81-4461-8bdb-6b5aa87bc4f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:33:06.233349 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.auth.core [None req-c9ac6cc5-3e81-4461-8bdb-6b5aa87bc4f2 None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:33:06.234552 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.fernet_utils [None req-c9ac6cc5-3e81-4461-8bdb-6b5aa87bc4f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:33:06.242272 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 540/1080] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 08:33:06 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 08:33:06.282551 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1552ba-cebe-453c-9f99-e254bb84377f None None] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:33:06.293352 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1552ba-cebe-453c-9f99-e254bb84377f None None] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:33:06.296893 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45897d7-6700-4390-8fe4-b08a4a6f5a13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56934ba9afb741679e0573167d6825f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '256f4731060449f1b80067e51e8bec00', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:33:06.297533 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45897d7-6700-4390-8fe4-b08a4a6f5a13 service neutron] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:33:06.297819 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45897d7-6700-4390-8fe4-b08a4a6f5a13 service neutron] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:33:06.298104 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45897d7-6700-4390-8fe4-b08a4a6f5a13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:33:06.307175 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45897d7-6700-4390-8fe4-b08a4a6f5a13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:33:06.308657 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45897d7-6700-4390-8fe4-b08a4a6f5a13 service neutron] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:33:06.318261 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 541/1081] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 08:33:06 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 08:33:08.692668 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0426f19a-6919-4f7b-a920-2b47160b0bf5 None None] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:33:08.693185 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0426f19a-6919-4f7b-a920-2b47160b0bf5 None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:33:08.693307 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0426f19a-6919-4f7b-a920-2b47160b0bf5 None None] PATH_INFO: `/` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:33:08.694603 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 541/1082] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 08:33:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:33:08.700809 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eef39ae-d07d-4d56-9c65-95f9936c3b11 None None] REQUEST_METHOD: `POST` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:33:08.701243 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eef39ae-d07d-4d56-9c65-95f9936c3b11 None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:33:08.701370 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eef39ae-d07d-4d56-9c65-95f9936c3b11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:33:08.719617 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.auth.core [None req-3eef39ae-d07d-4d56-9c65-95f9936c3b11 None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:33:08.720841 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.fernet_utils [None req-3eef39ae-d07d-4d56-9c65-95f9936c3b11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:33:08.728556 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 542/1083] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 08:33:08 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 08:33:08.767507 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0426f19a-6919-4f7b-a920-2b47160b0bf5 None None] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:33:08.779208 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0426f19a-6919-4f7b-a920-2b47160b0bf5 None None] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:33:08.782818 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0883bf1b-6015-451a-9706-54ec8f9173f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56934ba9afb741679e0573167d6825f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '256f4731060449f1b80067e51e8bec00', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:33:08.783454 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0883bf1b-6015-451a-9706-54ec8f9173f4 service neutron] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:33:08.783736 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0883bf1b-6015-451a-9706-54ec8f9173f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:33:08.784015 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0883bf1b-6015-451a-9706-54ec8f9173f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:33:08.793216 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0883bf1b-6015-451a-9706-54ec8f9173f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:33:08.794760 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0883bf1b-6015-451a-9706-54ec8f9173f4 service neutron] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:33:08.804297 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 542/1084] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 08:33:08 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 08:33:11.248023 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb1d415-4226-41fa-9182-614be184d400 None None] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:33:11.248537 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb1d415-4226-41fa-9182-614be184d400 None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:33:11.248537 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb1d415-4226-41fa-9182-614be184d400 None None] PATH_INFO: `/` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:33:11.249891 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 543/1085] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 08:33:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 08:33:11.255812 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963a4d61-cc01-482b-aad6-ec28ddc9cc29 None None] REQUEST_METHOD: `POST` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:33:11.256284 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963a4d61-cc01-482b-aad6-ec28ddc9cc29 None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:33:11.256464 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963a4d61-cc01-482b-aad6-ec28ddc9cc29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:33:11.277790 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.auth.core [None req-963a4d61-cc01-482b-aad6-ec28ddc9cc29 None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:33:11.279705 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.fernet_utils [None req-963a4d61-cc01-482b-aad6-ec28ddc9cc29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:33:11.289211 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 543/1086] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 08:33:11 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 08:33:11.329637 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb1d415-4226-41fa-9182-614be184d400 None None] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:33:11.340995 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb1d415-4226-41fa-9182-614be184d400 None None] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:33:11.344556 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c7070d-816f-440d-a6fc-3199f5d05236 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56934ba9afb741679e0573167d6825f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '256f4731060449f1b80067e51e8bec00', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:33:11.345236 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c7070d-816f-440d-a6fc-3199f5d05236 service neutron] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:33:11.345529 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c7070d-816f-440d-a6fc-3199f5d05236 service neutron] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:33:11.345808 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c7070d-816f-440d-a6fc-3199f5d05236 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:33:11.356247 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c7070d-816f-440d-a6fc-3199f5d05236 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:33:11.357825 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c7070d-816f-440d-a6fc-3199f5d05236 service neutron] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:33:11.367713 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 544/1087] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 08:33:11 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 08:33:21.269804 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=20 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:33:21.363353 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=23 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:33:46.356441 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5117b300-3c70-465b-8bbd-cbb7a844c3bc None None] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:33:46.357124 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5117b300-3c70-465b-8bbd-cbb7a844c3bc None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:33:46.357124 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5117b300-3c70-465b-8bbd-cbb7a844c3bc None None] PATH_INFO: `/` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:33:46.358417 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 544/1088] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:33:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:33:46.363674 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7418d84-405a-4fd9-913e-07b90c493500 None None] REQUEST_METHOD: `POST` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:33:46.364142 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7418d84-405a-4fd9-913e-07b90c493500 None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:33:46.364236 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7418d84-405a-4fd9-913e-07b90c493500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:33:46.383662 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.auth.core [None req-c7418d84-405a-4fd9-913e-07b90c493500 None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:33:46.385660 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.fernet_utils [None req-c7418d84-405a-4fd9-913e-07b90c493500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:33:46.393894 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 545/1089] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:33:46 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 08:33:46.443979 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c642b9-b10c-4d00-91a7-133d657f0f36 None None] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:33:46.444275 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c642b9-b10c-4d00-91a7-133d657f0f36 None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:33:46.444560 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c642b9-b10c-4d00-91a7-133d657f0f36 None None] PATH_INFO: `/` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:33:46.445984 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 545/1090] 10.222.0.62 () {54 vars in 962 bytes} [Fri May 27 08:33:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:33:46.452473 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f428958-217b-478d-93a8-7a0153a40c7a None None] REQUEST_METHOD: `POST` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:33:46.452799 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f428958-217b-478d-93a8-7a0153a40c7a None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:33:46.453081 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f428958-217b-478d-93a8-7a0153a40c7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:33:46.471224 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.auth.core [None req-8f428958-217b-478d-93a8-7a0153a40c7a None None] MFA Rules not processed for user `2af5ebcf47654d08881584431b199416`. Rule list: `[]` (Enabled: `True`). {{(pid=87173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:33:46.472431 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.fernet_utils [None req-8f428958-217b-478d-93a8-7a0153a40c7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:33:46.478939 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 546/1091] 10.222.0.62 () {58 vars in 1059 bytes} [Fri May 27 08:33:46 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 08:33:46.486596 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c642b9-b10c-4d00-91a7-133d657f0f36 None None] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:33:46.498175 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c642b9-b10c-4d00-91a7-133d657f0f36 None None] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:33:46.501721 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1376d41a-7d17-4141-a9b7-45ba4dbca178 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af5ebcf47654d08881584431b199416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '256f4731060449f1b80067e51e8bec00', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:33:46.502369 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1376d41a-7d17-4141-a9b7-45ba4dbca178 service glance] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:33:46.502647 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1376d41a-7d17-4141-a9b7-45ba4dbca178 service glance] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:33:46.502925 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1376d41a-7d17-4141-a9b7-45ba4dbca178 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:33:46.513266 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1376d41a-7d17-4141-a9b7-45ba4dbca178 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:33:46.514701 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1376d41a-7d17-4141-a9b7-45ba4dbca178 service glance] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:33:46.524422 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 546/1092] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 08:33:46 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 08:33:48.988755 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad7d5bd-57af-4cf1-9fbd-583b4f9b5a64 None None] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:33:48.989359 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad7d5bd-57af-4cf1-9fbd-583b4f9b5a64 None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:33:48.989359 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad7d5bd-57af-4cf1-9fbd-583b4f9b5a64 None None] PATH_INFO: `/` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:33:48.990852 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 547/1093] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:33:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:33:48.997200 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3953615a-bcc0-42ad-b433-6d91d0e9f9bb None None] REQUEST_METHOD: `POST` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:33:48.997750 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3953615a-bcc0-42ad-b433-6d91d0e9f9bb None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:33:48.997852 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3953615a-bcc0-42ad-b433-6d91d0e9f9bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:33:49.018250 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.auth.core [None req-3953615a-bcc0-42ad-b433-6d91d0e9f9bb None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:33:49.019512 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.fernet_utils [None req-3953615a-bcc0-42ad-b433-6d91d0e9f9bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:33:49.028863 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 547/1094] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:33:48 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 08:33:49.055100 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad7d5bd-57af-4cf1-9fbd-583b4f9b5a64 None None] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:33:49.068954 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad7d5bd-57af-4cf1-9fbd-583b4f9b5a64 None None] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:33:49.074397 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cbc044-892d-4fc7-b639-d84f2eb14654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db9f476e682c4ed795ebf3f955e975c9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:33:49.075009 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cbc044-892d-4fc7-b639-d84f2eb14654 admin admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:33:49.075316 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cbc044-892d-4fc7-b639-d84f2eb14654 admin admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:33:49.075594 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cbc044-892d-4fc7-b639-d84f2eb14654 admin admin] PATH_INFO: `/v3/projects` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:33:49.076399 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cbc044-892d-4fc7-b639-d84f2eb14654 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:33:49.078480 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: WARNING py.warnings [None req-87cbc044-892d-4fc7-b639-d84f2eb14654 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 27 08:33:49.078480 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: warnings.warn(msg) May 27 08:33:49.078480 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: May 27 08:33:49.079743 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cbc044-892d-4fc7-b639-d84f2eb14654 admin admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:33:49.102619 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 548/1095] 10.222.0.62 () {56 vars in 1108 bytes} [Fri May 27 08:33:49 2022] GET /identity/v3/projects => generated 1606 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 08:33:51.461515 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eddd74-d302-481a-a96c-0ffdae08b972 None None] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:33:51.462087 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eddd74-d302-481a-a96c-0ffdae08b972 None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:33:51.462087 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eddd74-d302-481a-a96c-0ffdae08b972 None None] PATH_INFO: `/` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:33:51.463768 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 548/1096] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:33:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:33:51.469605 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9da7051-dc65-4f26-af63-5018ee59f022 None None] REQUEST_METHOD: `POST` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:33:51.470100 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9da7051-dc65-4f26-af63-5018ee59f022 None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:33:51.470211 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9da7051-dc65-4f26-af63-5018ee59f022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:33:51.489843 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.auth.core [None req-b9da7051-dc65-4f26-af63-5018ee59f022 None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:33:51.491066 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.fernet_utils [None req-b9da7051-dc65-4f26-af63-5018ee59f022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:33:51.499694 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 549/1097] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:33:51 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 08:33:51.549255 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eddd74-d302-481a-a96c-0ffdae08b972 None None] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:33:51.567279 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eddd74-d302-481a-a96c-0ffdae08b972 None None] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:33:51.577620 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c2cc76-bc97-4b33-8ab6-4e690ff73d74 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a09bdc2dbac4f9abe450ff121e7dce8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '256f4731060449f1b80067e51e8bec00', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:33:51.578983 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c2cc76-bc97-4b33-8ab6-4e690ff73d74 service nova] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:33:51.579788 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c2cc76-bc97-4b33-8ab6-4e690ff73d74 service nova] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:33:51.580531 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c2cc76-bc97-4b33-8ab6-4e690ff73d74 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:33:51.593169 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c2cc76-bc97-4b33-8ab6-4e690ff73d74 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:33:51.595151 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c2cc76-bc97-4b33-8ab6-4e690ff73d74 service nova] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:33:51.608145 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 549/1098] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 08:33:51 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 08:33:54.251737 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5484cfab-4829-4330-ab16-2bcb93d646de None None] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:33:54.252272 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5484cfab-4829-4330-ab16-2bcb93d646de None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:33:54.252272 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5484cfab-4829-4330-ab16-2bcb93d646de None None] PATH_INFO: `/` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:33:54.254212 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 550/1099] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:33:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:33:54.260333 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990918d0-9036-463b-8be0-b73786af64df None None] REQUEST_METHOD: `POST` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:33:54.260888 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990918d0-9036-463b-8be0-b73786af64df None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:33:54.261005 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990918d0-9036-463b-8be0-b73786af64df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:33:54.279804 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.auth.core [None req-990918d0-9036-463b-8be0-b73786af64df None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:33:54.280997 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.fernet_utils [None req-990918d0-9036-463b-8be0-b73786af64df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:33:54.289644 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 550/1100] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:33:54 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 08:33:54.327742 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5484cfab-4829-4330-ab16-2bcb93d646de None None] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:33:54.339867 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5484cfab-4829-4330-ab16-2bcb93d646de None None] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:33:54.343507 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b02836-8306-4995-aefa-61bf1dded6e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56934ba9afb741679e0573167d6825f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '256f4731060449f1b80067e51e8bec00', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:33:54.344146 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b02836-8306-4995-aefa-61bf1dded6e5 service neutron] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:33:54.344422 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b02836-8306-4995-aefa-61bf1dded6e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:33:54.344739 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b02836-8306-4995-aefa-61bf1dded6e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:33:54.354395 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b02836-8306-4995-aefa-61bf1dded6e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:33:54.355854 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b02836-8306-4995-aefa-61bf1dded6e5 service neutron] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:33:54.365803 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 551/1101] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 08:33:54 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 08:33:56.793608 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b63850-c7b5-4aa3-a748-7c0d6f65bd40 None None] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:33:56.794208 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b63850-c7b5-4aa3-a748-7c0d6f65bd40 None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:33:56.794208 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b63850-c7b5-4aa3-a748-7c0d6f65bd40 None None] PATH_INFO: `/` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:33:56.795457 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 551/1102] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:33:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:33:56.801228 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18ae099-21f6-495a-a184-62ce67033e3f None None] REQUEST_METHOD: `POST` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:33:56.801706 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18ae099-21f6-495a-a184-62ce67033e3f None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:33:56.801811 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18ae099-21f6-495a-a184-62ce67033e3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:33:56.819849 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.auth.core [None req-b18ae099-21f6-495a-a184-62ce67033e3f None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:33:56.821111 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.fernet_utils [None req-b18ae099-21f6-495a-a184-62ce67033e3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:33:56.829721 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 552/1103] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:33:56 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 08:33:56.870242 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b63850-c7b5-4aa3-a748-7c0d6f65bd40 None None] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:33:56.882626 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b63850-c7b5-4aa3-a748-7c0d6f65bd40 None None] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:33:56.887968 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4e79a1-1647-47dd-9e9d-622ade784d01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56934ba9afb741679e0573167d6825f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '256f4731060449f1b80067e51e8bec00', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:33:56.889049 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4e79a1-1647-47dd-9e9d-622ade784d01 service neutron] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:33:56.889385 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4e79a1-1647-47dd-9e9d-622ade784d01 service neutron] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:33:56.889707 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4e79a1-1647-47dd-9e9d-622ade784d01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:33:56.900067 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4e79a1-1647-47dd-9e9d-622ade784d01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:33:56.901598 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4e79a1-1647-47dd-9e9d-622ade784d01 service neutron] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:33:56.915351 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 552/1104] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 08:33:56 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 08:33:59.413934 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f69c28-8dda-4dff-8a4f-3830291ab0bc None None] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:33:59.414508 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f69c28-8dda-4dff-8a4f-3830291ab0bc None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:33:59.414508 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f69c28-8dda-4dff-8a4f-3830291ab0bc None None] PATH_INFO: `/` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:33:59.415880 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 553/1105] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:33:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:33:59.422161 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26930b8-ebf8-4f53-a683-567b829c020c None None] REQUEST_METHOD: `POST` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:33:59.422677 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26930b8-ebf8-4f53-a683-567b829c020c None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:33:59.422789 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26930b8-ebf8-4f53-a683-567b829c020c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:33:59.440956 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.auth.core [None req-e26930b8-ebf8-4f53-a683-567b829c020c None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:33:59.442178 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.fernet_utils [None req-e26930b8-ebf8-4f53-a683-567b829c020c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:33:59.450150 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 553/1106] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:33:59 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 08:33:59.494093 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f69c28-8dda-4dff-8a4f-3830291ab0bc None None] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:33:59.506549 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f69c28-8dda-4dff-8a4f-3830291ab0bc None None] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:33:59.510922 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4218f6ac-9a41-442e-8392-1f343bb7e646 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56934ba9afb741679e0573167d6825f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '256f4731060449f1b80067e51e8bec00', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:33:59.511575 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4218f6ac-9a41-442e-8392-1f343bb7e646 service neutron] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:33:59.511874 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4218f6ac-9a41-442e-8392-1f343bb7e646 service neutron] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:33:59.512144 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4218f6ac-9a41-442e-8392-1f343bb7e646 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:33:59.522090 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4218f6ac-9a41-442e-8392-1f343bb7e646 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:33:59.523561 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4218f6ac-9a41-442e-8392-1f343bb7e646 service neutron] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:33:59.535045 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 554/1107] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 08:33:59 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 08:34:02.109971 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b448432-3b7c-4f4b-9233-c8a8136223d3 None None] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:34:02.110546 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b448432-3b7c-4f4b-9233-c8a8136223d3 None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:34:02.110546 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b448432-3b7c-4f4b-9233-c8a8136223d3 None None] PATH_INFO: `/` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:34:02.111951 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 554/1108] 10.222.0.62 () {54 vars in 926 bytes} [Fri May 27 08:34:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:34:02.122807 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca146df-5e8b-48da-af72-57d74fc8cf9c None None] REQUEST_METHOD: `POST` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:34:02.123670 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca146df-5e8b-48da-af72-57d74fc8cf9c None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:34:02.123670 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca146df-5e8b-48da-af72-57d74fc8cf9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:34:02.142810 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.auth.core [None req-6ca146df-5e8b-48da-af72-57d74fc8cf9c None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:34:02.144035 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.fernet_utils [None req-6ca146df-5e8b-48da-af72-57d74fc8cf9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:34:02.152963 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 555/1109] 10.222.0.62 () {58 vars in 1023 bytes} [Fri May 27 08:34:02 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 08:34:02.196936 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b448432-3b7c-4f4b-9233-c8a8136223d3 None None] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:34:02.209067 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b448432-3b7c-4f4b-9233-c8a8136223d3 None None] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:34:02.213691 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423f7626-0b9a-4300-8cec-60db4455693d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56934ba9afb741679e0573167d6825f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '256f4731060449f1b80067e51e8bec00', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:34:02.214356 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423f7626-0b9a-4300-8cec-60db4455693d service neutron] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:34:02.214643 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423f7626-0b9a-4300-8cec-60db4455693d service neutron] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:34:02.214919 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423f7626-0b9a-4300-8cec-60db4455693d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:34:02.225756 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423f7626-0b9a-4300-8cec-60db4455693d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:34:02.227373 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423f7626-0b9a-4300-8cec-60db4455693d service neutron] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:34:02.238800 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 555/1110] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 08:34:02 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 08:34:12.136983 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=33 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:34:12.234007 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=33 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:35:46.828283 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b473dc90-41a8-4067-971b-9e9dd436a7c4 None None] REQUEST_METHOD: `POST` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:35:46.828932 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b473dc90-41a8-4067-971b-9e9dd436a7c4 None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:35:46.828932 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b473dc90-41a8-4067-971b-9e9dd436a7c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:35:46.873532 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.auth.core [None req-b473dc90-41a8-4067-971b-9e9dd436a7c4 None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:35:46.875626 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.fernet_utils [None req-b473dc90-41a8-4067-971b-9e9dd436a7c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:35:46.916966 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 556/1111] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 08:35:46 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 08:35:46.927530 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669e2b55-a666-4b55-82df-a42442f9ee72 None None] REQUEST_METHOD: `POST` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:35:46.928196 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669e2b55-a666-4b55-82df-a42442f9ee72 None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:35:46.928196 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669e2b55-a666-4b55-82df-a42442f9ee72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:35:46.947097 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.auth.core [None req-669e2b55-a666-4b55-82df-a42442f9ee72 None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:35:46.948352 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.fernet_utils [None req-669e2b55-a666-4b55-82df-a42442f9ee72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:35:46.957081 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 556/1112] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 08:35:46 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 08:35:46.961716 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b473dc90-41a8-4067-971b-9e9dd436a7c4 None None] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:35:46.971533 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b473dc90-41a8-4067-971b-9e9dd436a7c4 None None] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:35:46.976376 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5195a129-23fc-4c2c-8d7d-8460c071792b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db9f476e682c4ed795ebf3f955e975c9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:35:46.977068 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5195a129-23fc-4c2c-8d7d-8460c071792b admin admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:35:46.977351 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5195a129-23fc-4c2c-8d7d-8460c071792b admin admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:35:46.977629 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5195a129-23fc-4c2c-8d7d-8460c071792b admin admin] PATH_INFO: `/v3/domains` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:35:46.978366 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5195a129-23fc-4c2c-8d7d-8460c071792b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:35:46.978657 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5195a129-23fc-4c2c-8d7d-8460c071792b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:35:46.979680 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: WARNING py.warnings [None req-5195a129-23fc-4c2c-8d7d-8460c071792b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 08:35:46.979680 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: warnings.warn(msg) May 27 08:35:46.979680 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: May 27 08:35:46.980563 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5195a129-23fc-4c2c-8d7d-8460c071792b admin admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:35:46.993618 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 557/1113] 10.222.0.62 () {58 vars in 1152 bytes} [Fri May 27 08:35:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:35:47.001839 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669e2b55-a666-4b55-82df-a42442f9ee72 None None] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:35:47.012065 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669e2b55-a666-4b55-82df-a42442f9ee72 None None] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:35:47.016568 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5667f4-d30a-4f69-9135-e4e88f53b2c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db9f476e682c4ed795ebf3f955e975c9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:35:47.017235 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5667f4-d30a-4f69-9135-e4e88f53b2c7 admin admin] REQUEST_METHOD: `POST` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:35:47.017521 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5667f4-d30a-4f69-9135-e4e88f53b2c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:35:47.017792 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5667f4-d30a-4f69-9135-e4e88f53b2c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:35:47.019398 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5667f4-d30a-4f69-9135-e4e88f53b2c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:35:47.021189 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: WARNING py.warnings [None req-3d5667f4-d30a-4f69-9135-e4e88f53b2c7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 27 08:35:47.021189 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: warnings.warn(msg) May 27 08:35:47.021189 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: May 27 08:35:47.022366 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5667f4-d30a-4f69-9135-e4e88f53b2c7 admin admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:35:47.057881 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 557/1114] 10.222.0.62 () {60 vars in 1152 bytes} [Fri May 27 08:35:47 2022] POST /identity/v3/projects => generated 377 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 08:35:47.062222 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5195a129-23fc-4c2c-8d7d-8460c071792b admin admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:35:47.072950 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5195a129-23fc-4c2c-8d7d-8460c071792b admin admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:35:47.129696 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d9bf42-9927-45fe-b53c-0f3cc73310b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db9f476e682c4ed795ebf3f955e975c9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:35:47.130379 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d9bf42-9927-45fe-b53c-0f3cc73310b1 admin admin] REQUEST_METHOD: `POST` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:35:47.130664 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d9bf42-9927-45fe-b53c-0f3cc73310b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:35:47.130938 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d9bf42-9927-45fe-b53c-0f3cc73310b1 admin admin] PATH_INFO: `/v3/users` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:35:47.131628 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d9bf42-9927-45fe-b53c-0f3cc73310b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:35:47.132697 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: WARNING py.warnings [None req-86d9bf42-9927-45fe-b53c-0f3cc73310b1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 27 08:35:47.132697 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: warnings.warn(msg) May 27 08:35:47.132697 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: May 27 08:35:47.133896 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d9bf42-9927-45fe-b53c-0f3cc73310b1 admin admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:35:47.154615 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 558/1115] 10.222.0.62 () {60 vars in 1143 bytes} [Fri May 27 08:35:47 2022] POST /identity/v3/users => generated 289 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 08:35:47.158890 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5667f4-d30a-4f69-9135-e4e88f53b2c7 admin admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:35:47.169402 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5667f4-d30a-4f69-9135-e4e88f53b2c7 admin admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:35:47.173891 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838e6917-c2c5-4aba-a931-425fe1013c3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db9f476e682c4ed795ebf3f955e975c9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:35:47.175196 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838e6917-c2c5-4aba-a931-425fe1013c3f admin admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:35:47.175704 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838e6917-c2c5-4aba-a931-425fe1013c3f admin admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:35:47.175997 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838e6917-c2c5-4aba-a931-425fe1013c3f admin admin] PATH_INFO: `/v3/roles` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:35:47.176760 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838e6917-c2c5-4aba-a931-425fe1013c3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:35:47.177775 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: WARNING py.warnings [None req-838e6917-c2c5-4aba-a931-425fe1013c3f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 08:35:47.177775 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: warnings.warn(msg) May 27 08:35:47.177775 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: May 27 08:35:47.178672 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838e6917-c2c5-4aba-a931-425fe1013c3f admin admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:35:47.192964 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 558/1116] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 08:35:47 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 08:35:47.197167 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d9bf42-9927-45fe-b53c-0f3cc73310b1 admin admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:35:47.207340 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d9bf42-9927-45fe-b53c-0f3cc73310b1 admin admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:35:47.212015 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bf1de7-c605-4fc4-82e4-d5959f671b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db9f476e682c4ed795ebf3f955e975c9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:35:47.212709 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bf1de7-c605-4fc4-82e4-d5959f671b64 admin admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:35:47.212997 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bf1de7-c605-4fc4-82e4-d5959f671b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:35:47.213277 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bf1de7-c605-4fc4-82e4-d5959f671b64 admin admin] PATH_INFO: `/v3/roles` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:35:47.214004 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bf1de7-c605-4fc4-82e4-d5959f671b64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:35:47.215028 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: WARNING py.warnings [None req-f9bf1de7-c605-4fc4-82e4-d5959f671b64 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 08:35:47.215028 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: warnings.warn(msg) May 27 08:35:47.215028 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: May 27 08:35:47.215910 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bf1de7-c605-4fc4-82e4-d5959f671b64 admin admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:35:47.229195 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 559/1117] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 08:35:47 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 08:35:47.233298 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838e6917-c2c5-4aba-a931-425fe1013c3f admin admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:35:47.244068 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838e6917-c2c5-4aba-a931-425fe1013c3f admin admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:35:47.248975 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952d36ee-1dab-41f3-9de8-aee14f131e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db9f476e682c4ed795ebf3f955e975c9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:35:47.249859 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952d36ee-1dab-41f3-9de8-aee14f131e51 admin admin] REQUEST_METHOD: `PUT` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:35:47.250262 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952d36ee-1dab-41f3-9de8-aee14f131e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:35:47.250543 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952d36ee-1dab-41f3-9de8-aee14f131e51 admin admin] PATH_INFO: `/v3/projects/5b1e7f887e964678bc75bb382a001e97/users/6ae779310728464da90f81c48c3be108/roles/c980c64bb84b418daa012ae45a054b37` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:35:47.266722 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952d36ee-1dab-41f3-9de8-aee14f131e51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b1e7f887e964678bc75bb382a001e97, user_id=6ae779310728464da90f81c48c3be108, role_id=c980c64bb84b418daa012ae45a054b37)` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:35:47.267758 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: WARNING py.warnings [None req-952d36ee-1dab-41f3-9de8-aee14f131e51 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 27 08:35:47.267758 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: warnings.warn(msg) May 27 08:35:47.267758 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: May 27 08:35:47.270016 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952d36ee-1dab-41f3-9de8-aee14f131e51 admin admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:35:47.283597 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 559/1118] 10.222.0.62 () {60 vars in 1482 bytes} [Fri May 27 08:35:47 2022] PUT /identity/v3/projects/5b1e7f887e964678bc75bb382a001e97/users/6ae779310728464da90f81c48c3be108/roles/c980c64bb84b418daa012ae45a054b37 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 08:35:47.295272 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85899c0c-2be4-4aa6-bbe7-433a8ab9da11 None None] REQUEST_METHOD: `POST` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:35:47.295548 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85899c0c-2be4-4aa6-bbe7-433a8ab9da11 None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:35:47.295850 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85899c0c-2be4-4aa6-bbe7-433a8ab9da11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:35:47.324475 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.auth.core [None req-85899c0c-2be4-4aa6-bbe7-433a8ab9da11 None None] MFA Rules not processed for user `6ae779310728464da90f81c48c3be108`. Rule list: `[]` (Enabled: `True`). {{(pid=87173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:35:47.325714 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.fernet_utils [None req-85899c0c-2be4-4aa6-bbe7-433a8ab9da11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:35:47.392124 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 560/1119] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 08:35:47 2022] POST /identity/v3/auth/tokens => generated 2804 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 08:35:47.405602 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c584291f-fde1-4ed2-8ca1-5149a68150b3 None None] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:35:47.405899 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c584291f-fde1-4ed2-8ca1-5149a68150b3 None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:35:47.406184 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c584291f-fde1-4ed2-8ca1-5149a68150b3 None None] PATH_INFO: `/` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:35:47.407614 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 560/1120] 10.222.0.62 () {54 vars in 963 bytes} [Fri May 27 08:35:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:35:47.412569 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e0330e-993f-4efa-a5f9-343676596ab6 None None] REQUEST_METHOD: `POST` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:35:47.412893 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e0330e-993f-4efa-a5f9-343676596ab6 None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:35:47.413175 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e0330e-993f-4efa-a5f9-343676596ab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:35:47.419397 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:35:47.434648 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.auth.core [None req-b6e0330e-993f-4efa-a5f9-343676596ab6 None None] MFA Rules not processed for user `839e73c51c5243b68335242a0d695842`. Rule list: `[]` (Enabled: `True`). {{(pid=87173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:35:47.435783 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.fernet_utils [None req-b6e0330e-993f-4efa-a5f9-343676596ab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:35:47.485642 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 561/1121] 10.222.0.62 () {58 vars in 1060 bytes} [Fri May 27 08:35:47 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 08:35:47.493789 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c584291f-fde1-4ed2-8ca1-5149a68150b3 None None] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:35:47.504728 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c584291f-fde1-4ed2-8ca1-5149a68150b3 None None] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:35:47.508231 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c84235-87e3-4e21-b35a-a810cb2cad33 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839e73c51c5243b68335242a0d695842', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '256f4731060449f1b80067e51e8bec00', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:35:47.508896 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c84235-87e3-4e21-b35a-a810cb2cad33 service cinder] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:35:47.509205 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c84235-87e3-4e21-b35a-a810cb2cad33 service cinder] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:35:47.509483 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c84235-87e3-4e21-b35a-a810cb2cad33 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:35:47.517752 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c84235-87e3-4e21-b35a-a810cb2cad33 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:35:47.519381 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c84235-87e3-4e21-b35a-a810cb2cad33 service cinder] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:35:47.528416 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 561/1122] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 08:35:47 2022] GET /identity/v3/auth/tokens => generated 2804 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 08:35:47.564076 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4fc526-183d-473f-aecd-2a5e35ff5012 None None] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:35:47.564371 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4fc526-183d-473f-aecd-2a5e35ff5012 None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:35:47.564703 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4fc526-183d-473f-aecd-2a5e35ff5012 None None] PATH_INFO: `/` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:35:47.566173 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 562/1123] 10.222.0.62 () {52 vars in 829 bytes} [Fri May 27 08:35:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:35:47.569710 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c84235-87e3-4e21-b35a-a810cb2cad33 service cinder] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:35:47.632688 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c84235-87e3-4e21-b35a-a810cb2cad33 service cinder] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:35:47.637252 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b93548-5817-4539-95a5-11d967d0688d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db9f476e682c4ed795ebf3f955e975c9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:35:47.638114 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b93548-5817-4539-95a5-11d967d0688d admin admin] REQUEST_METHOD: `DELETE` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:35:47.638398 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b93548-5817-4539-95a5-11d967d0688d admin admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:35:47.638669 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b93548-5817-4539-95a5-11d967d0688d admin admin] PATH_INFO: `/v3/users/6ae779310728464da90f81c48c3be108` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:35:47.639889 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b93548-5817-4539-95a5-11d967d0688d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ae779310728464da90f81c48c3be108)` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:35:47.640939 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: WARNING py.warnings [None req-63b93548-5817-4539-95a5-11d967d0688d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 27 08:35:47.640939 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: warnings.warn(msg) May 27 08:35:47.640939 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: May 27 08:35:47.642132 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b93548-5817-4539-95a5-11d967d0688d admin admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:35:47.706210 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.notifications [None req-63b93548-5817-4539-95a5-11d967d0688d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ae779310728464da90f81c48c3be108'} {{(pid=87172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 08:35:47.718313 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.notifications [None req-63b93548-5817-4539-95a5-11d967d0688d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ae779310728464da90f81c48c3be108'} {{(pid=87172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 08:35:47.718989 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.notifications [None req-63b93548-5817-4539-95a5-11d967d0688d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ae779310728464da90f81c48c3be108'} {{(pid=87172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 08:35:47.729016 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.notifications [None req-63b93548-5817-4539-95a5-11d967d0688d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ae779310728464da90f81c48c3be108'} {{(pid=87172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 08:35:47.729737 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.notifications [None req-63b93548-5817-4539-95a5-11d967d0688d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ae779310728464da90f81c48c3be108'} {{(pid=87172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 08:35:47.745924 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:35:47.756009 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 562/1124] 10.222.0.62 () {58 vars in 1223 bytes} [Fri May 27 08:35:47 2022] DELETE /identity/v3/users/6ae779310728464da90f81c48c3be108 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 08:35:47.760463 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc378cdb-c62c-4682-afb1-acdcf7a4c891 None None] REQUEST_METHOD: `POST` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:35:47.760790 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc378cdb-c62c-4682-afb1-acdcf7a4c891 None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:35:47.761073 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc378cdb-c62c-4682-afb1-acdcf7a4c891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:35:47.779076 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.auth.core [None req-cc378cdb-c62c-4682-afb1-acdcf7a4c891 None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:35:47.780308 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.fernet_utils [None req-cc378cdb-c62c-4682-afb1-acdcf7a4c891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:35:47.849072 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 563/1125] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 08:35:47 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 08:35:47.861252 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b93548-5817-4539-95a5-11d967d0688d admin admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:35:47.863452 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.fernet_utils [None req-63b93548-5817-4539-95a5-11d967d0688d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:35:47.925397 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b93548-5817-4539-95a5-11d967d0688d admin admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:35:47.929248 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c3936a-a668-42ed-9ca0-efbec9e1a131 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56934ba9afb741679e0573167d6825f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '256f4731060449f1b80067e51e8bec00', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:35:47.929899 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c3936a-a668-42ed-9ca0-efbec9e1a131 service neutron] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:35:47.930181 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c3936a-a668-42ed-9ca0-efbec9e1a131 service neutron] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:35:47.930460 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c3936a-a668-42ed-9ca0-efbec9e1a131 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:35:47.939609 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c3936a-a668-42ed-9ca0-efbec9e1a131 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:35:47.941712 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c3936a-a668-42ed-9ca0-efbec9e1a131 service neutron] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:35:47.951062 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 563/1126] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 08:35:47 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 08:35:48.336271 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc378cdb-c62c-4682-afb1-acdcf7a4c891 None None] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:35:48.337747 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.fernet_utils [None req-cc378cdb-c62c-4682-afb1-acdcf7a4c891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:35:48.350528 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc378cdb-c62c-4682-afb1-acdcf7a4c891 None None] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:35:48.355372 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f66e4c9-7470-4b86-bf9d-04621ca04482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db9f476e682c4ed795ebf3f955e975c9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:35:48.356321 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f66e4c9-7470-4b86-bf9d-04621ca04482 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:35:48.356631 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f66e4c9-7470-4b86-bf9d-04621ca04482 admin admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:35:48.356913 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f66e4c9-7470-4b86-bf9d-04621ca04482 admin admin] PATH_INFO: `/v3/projects/5b1e7f887e964678bc75bb382a001e97` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:35:48.358123 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f66e4c9-7470-4b86-bf9d-04621ca04482 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b1e7f887e964678bc75bb382a001e97)` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:35:48.359139 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: WARNING py.warnings [None req-6f66e4c9-7470-4b86-bf9d-04621ca04482 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 27 08:35:48.359139 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: warnings.warn(msg) May 27 08:35:48.359139 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: May 27 08:35:48.360356 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f66e4c9-7470-4b86-bf9d-04621ca04482 admin admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:35:48.423668 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.notifications [None req-6f66e4c9-7470-4b86-bf9d-04621ca04482 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b1e7f887e964678bc75bb382a001e97', 'request_id': 'req-6f66e4c9-7470-4b86-bf9d-04621ca04482'} {{(pid=87173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 08:35:48.430155 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.notifications [None req-6f66e4c9-7470-4b86-bf9d-04621ca04482 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b1e7f887e964678bc75bb382a001e97', 'request_id': 'req-6f66e4c9-7470-4b86-bf9d-04621ca04482'} {{(pid=87173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 08:35:48.444509 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.notifications [None req-6f66e4c9-7470-4b86-bf9d-04621ca04482 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b1e7f887e964678bc75bb382a001e97', 'request_id': 'req-6f66e4c9-7470-4b86-bf9d-04621ca04482'} {{(pid=87173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 08:35:48.459884 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.notifications [None req-6f66e4c9-7470-4b86-bf9d-04621ca04482 admin admin] The token cache is being invalidate because project 5b1e7f887e964678bc75bb382a001e97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87173) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 08:35:48.460174 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.notifications [None req-6f66e4c9-7470-4b86-bf9d-04621ca04482 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 08:35:48.460976 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.notifications [None req-6f66e4c9-7470-4b86-bf9d-04621ca04482 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 08:35:48.462541 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 564/1127] 10.222.0.62 () {58 vars in 1232 bytes} [Fri May 27 08:35:48 2022] DELETE /identity/v3/projects/5b1e7f887e964678bc75bb382a001e97 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 08:35:57.947064 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:35:58.455949 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=76,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:37:12.069933 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4168cad1-0c4c-45c9-98db-c78b60b5e684 None None] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:37:12.070509 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4168cad1-0c4c-45c9-98db-c78b60b5e684 None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:37:12.070509 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4168cad1-0c4c-45c9-98db-c78b60b5e684 None None] PATH_INFO: `/` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:37:12.071859 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 564/1128] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 27 08:37:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:37:12.076844 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e6ee4f-d94d-4764-a315-ca52b10be26b None None] REQUEST_METHOD: `POST` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:37:12.077288 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e6ee4f-d94d-4764-a315-ca52b10be26b None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:37:12.077404 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e6ee4f-d94d-4764-a315-ca52b10be26b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:37:12.128291 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.auth.core [None req-84e6ee4f-d94d-4764-a315-ca52b10be26b None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:37:12.129568 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.fernet_utils [None req-84e6ee4f-d94d-4764-a315-ca52b10be26b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:37:12.191261 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 565/1129] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 27 08:37:12 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 08:37:12.369554 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4168cad1-0c4c-45c9-98db-c78b60b5e684 None None] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:37:12.371312 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.fernet_utils [None req-4168cad1-0c4c-45c9-98db-c78b60b5e684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:37:12.465585 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4168cad1-0c4c-45c9-98db-c78b60b5e684 None None] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:37:12.470487 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c0f873-c2d9-4163-ab30-b46fc72c0d4e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a09bdc2dbac4f9abe450ff121e7dce8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '256f4731060449f1b80067e51e8bec00', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:37:12.471125 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c0f873-c2d9-4163-ab30-b46fc72c0d4e service nova] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:37:12.471405 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c0f873-c2d9-4163-ab30-b46fc72c0d4e service nova] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:37:12.471679 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c0f873-c2d9-4163-ab30-b46fc72c0d4e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:37:12.481230 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c0f873-c2d9-4163-ab30-b46fc72c0d4e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:37:12.482808 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c0f873-c2d9-4163-ab30-b46fc72c0d4e service nova] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:37:12.492528 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 565/1130] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 08:37:12 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 08:37:13.375351 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee948463-24ac-40ba-aa73-f12c6b8ac715 None None] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:37:13.375920 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee948463-24ac-40ba-aa73-f12c6b8ac715 None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:37:13.375920 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee948463-24ac-40ba-aa73-f12c6b8ac715 None None] PATH_INFO: `/` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:37:13.377347 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 566/1131] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 27 08:37:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:37:13.382180 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c212e6d4-e5c2-42e0-a23c-2db3b4485c4c None None] REQUEST_METHOD: `POST` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:37:13.382627 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c212e6d4-e5c2-42e0-a23c-2db3b4485c4c None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:37:13.382733 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c212e6d4-e5c2-42e0-a23c-2db3b4485c4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:37:13.401931 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.auth.core [None req-c212e6d4-e5c2-42e0-a23c-2db3b4485c4c None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:37:13.403391 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.fernet_utils [None req-c212e6d4-e5c2-42e0-a23c-2db3b4485c4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:37:13.412557 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 566/1132] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 27 08:37:13 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 08:37:13.569225 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee948463-24ac-40ba-aa73-f12c6b8ac715 None None] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:37:13.582571 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee948463-24ac-40ba-aa73-f12c6b8ac715 None None] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:37:13.588111 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7875e128-a35d-4e77-a2d8-54a1848fa56c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a09bdc2dbac4f9abe450ff121e7dce8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '256f4731060449f1b80067e51e8bec00', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:37:13.588777 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7875e128-a35d-4e77-a2d8-54a1848fa56c service nova] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:37:13.589060 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7875e128-a35d-4e77-a2d8-54a1848fa56c service nova] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:37:13.589336 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7875e128-a35d-4e77-a2d8-54a1848fa56c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:37:13.597548 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7875e128-a35d-4e77-a2d8-54a1848fa56c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:37:13.599618 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7875e128-a35d-4e77-a2d8-54a1848fa56c service nova] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:37:13.608967 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 567/1133] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 08:37:13 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 08:37:17.805417 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3c2a4b-82a1-4dc6-b473-a53256d4dd12 None None] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:37:17.806001 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3c2a4b-82a1-4dc6-b473-a53256d4dd12 None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:37:17.806001 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3c2a4b-82a1-4dc6-b473-a53256d4dd12 None None] PATH_INFO: `/v3` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:37:17.807278 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 567/1134] 10.222.0.66 () {54 vars in 925 bytes} [Fri May 27 08:37:17 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:37:17.813430 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab11ffc7-ff67-4c5b-b984-47e585b308c0 None None] REQUEST_METHOD: `POST` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:37:17.813891 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab11ffc7-ff67-4c5b-b984-47e585b308c0 None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:37:17.814013 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab11ffc7-ff67-4c5b-b984-47e585b308c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:37:17.843645 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.auth.core [None req-ab11ffc7-ff67-4c5b-b984-47e585b308c0 None None] MFA Rules not processed for user `7b12a598052a4b749edb0c021d99b951`. Rule list: `[]` (Enabled: `True`). {{(pid=87173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:37:17.844916 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.fernet_utils [None req-ab11ffc7-ff67-4c5b-b984-47e585b308c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:37:17.914311 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 568/1135] 10.222.0.66 () {58 vars in 1015 bytes} [Fri May 27 08:37:17 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 08:37:23.396379 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=42 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:37:25.023970 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5c7654-5180-4085-ba53-aefb61e99a35 None None] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:37:25.024611 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5c7654-5180-4085-ba53-aefb61e99a35 None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:37:25.024611 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5c7654-5180-4085-ba53-aefb61e99a35 None None] PATH_INFO: `/` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:37:25.025849 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 568/1136] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 27 08:37:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 08:37:25.032966 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e00dd6-5b58-46b1-aa86-a669d6ff7ed3 None None] REQUEST_METHOD: `POST` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:37:25.032966 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e00dd6-5b58-46b1-aa86-a669d6ff7ed3 None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:37:25.032966 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e00dd6-5b58-46b1-aa86-a669d6ff7ed3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:37:25.051966 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.auth.core [None req-01e00dd6-5b58-46b1-aa86-a669d6ff7ed3 None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:37:25.053819 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.fernet_utils [None req-01e00dd6-5b58-46b1-aa86-a669d6ff7ed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:37:25.062042 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 569/1137] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 27 08:37:25 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 08:37:25.220433 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5c7654-5180-4085-ba53-aefb61e99a35 None None] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:37:25.234899 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5c7654-5180-4085-ba53-aefb61e99a35 None None] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:37:25.239697 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad7e25c-3642-48f1-a962-db8e1a70fb56 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a09bdc2dbac4f9abe450ff121e7dce8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '256f4731060449f1b80067e51e8bec00', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:37:25.240468 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad7e25c-3642-48f1-a962-db8e1a70fb56 service nova] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:37:25.240788 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad7e25c-3642-48f1-a962-db8e1a70fb56 service nova] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:37:25.241204 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad7e25c-3642-48f1-a962-db8e1a70fb56 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:37:25.249351 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad7e25c-3642-48f1-a962-db8e1a70fb56 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:37:25.251232 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad7e25c-3642-48f1-a962-db8e1a70fb56 service nova] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:37:25.260764 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 569/1138] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 08:37:25 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 08:37:26.154510 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131011e5-bc30-4f0e-a38b-657249041e8b None None] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:37:26.155049 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131011e5-bc30-4f0e-a38b-657249041e8b None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:37:26.155049 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131011e5-bc30-4f0e-a38b-657249041e8b None None] PATH_INFO: `/` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:37:26.156548 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 570/1139] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 27 08:37:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:37:26.161502 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46065198-e705-4cc3-b264-3572f276924a None None] REQUEST_METHOD: `POST` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:37:26.163737 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46065198-e705-4cc3-b264-3572f276924a None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:37:26.163737 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46065198-e705-4cc3-b264-3572f276924a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:37:26.181252 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.auth.core [None req-46065198-e705-4cc3-b264-3572f276924a None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:37:26.182472 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.fernet_utils [None req-46065198-e705-4cc3-b264-3572f276924a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:37:26.190350 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 570/1140] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 27 08:37:26 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 08:37:26.346772 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131011e5-bc30-4f0e-a38b-657249041e8b None None] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:37:26.361584 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131011e5-bc30-4f0e-a38b-657249041e8b None None] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:37:26.368108 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ded81b0-7aa8-4f4b-95e3-280de48497b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a09bdc2dbac4f9abe450ff121e7dce8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '256f4731060449f1b80067e51e8bec00', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:37:26.369206 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ded81b0-7aa8-4f4b-95e3-280de48497b1 service nova] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:37:26.369206 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ded81b0-7aa8-4f4b-95e3-280de48497b1 service nova] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:37:26.369681 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ded81b0-7aa8-4f4b-95e3-280de48497b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:37:26.379036 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ded81b0-7aa8-4f4b-95e3-280de48497b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:37:26.380679 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ded81b0-7aa8-4f4b-95e3-280de48497b1 service nova] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:37:26.392052 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 571/1141] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 08:37:26 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 08:37:26.892226 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8a1eb3-78a7-4115-aba2-b0aea4af3f81 None None] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:37:26.892513 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8a1eb3-78a7-4115-aba2-b0aea4af3f81 None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:37:26.892830 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8a1eb3-78a7-4115-aba2-b0aea4af3f81 None None] PATH_INFO: `/` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:37:26.894230 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 571/1142] 10.222.0.62 () {54 vars in 960 bytes} [Fri May 27 08:37:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:37:26.900075 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a038ce51-a2cc-4f7f-8cb5-f4770377d6fe None None] REQUEST_METHOD: `POST` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:37:26.900375 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a038ce51-a2cc-4f7f-8cb5-f4770377d6fe None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:37:26.900691 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a038ce51-a2cc-4f7f-8cb5-f4770377d6fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:37:26.919621 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.auth.core [None req-a038ce51-a2cc-4f7f-8cb5-f4770377d6fe None None] MFA Rules not processed for user `7b12a598052a4b749edb0c021d99b951`. Rule list: `[]` (Enabled: `True`). {{(pid=87173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:37:26.920904 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.fernet_utils [None req-a038ce51-a2cc-4f7f-8cb5-f4770377d6fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:37:26.930922 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 572/1143] 10.222.0.62 () {58 vars in 1057 bytes} [Fri May 27 08:37:26 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 08:37:26.938731 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8a1eb3-78a7-4115-aba2-b0aea4af3f81 None None] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:37:26.956773 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8a1eb3-78a7-4115-aba2-b0aea4af3f81 None None] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:37:26.962396 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279c2bd1-6a70-4d52-822a-aa542cf6166b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b12a598052a4b749edb0c021d99b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '256f4731060449f1b80067e51e8bec00', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:37:26.963050 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279c2bd1-6a70-4d52-822a-aa542cf6166b service placement] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:37:26.963366 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279c2bd1-6a70-4d52-822a-aa542cf6166b service placement] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:37:26.963647 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279c2bd1-6a70-4d52-822a-aa542cf6166b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:37:26.972848 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279c2bd1-6a70-4d52-822a-aa542cf6166b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:37:26.974453 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279c2bd1-6a70-4d52-822a-aa542cf6166b service placement] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:37:26.984867 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 572/1144] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 08:37:26 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 08:37:30.603740 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e490fbd-5f01-413e-b666-246fcf4c5d33 None None] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:37:30.604664 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e490fbd-5f01-413e-b666-246fcf4c5d33 None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:37:30.604664 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e490fbd-5f01-413e-b666-246fcf4c5d33 None None] PATH_INFO: `/` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:37:30.606240 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 573/1145] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 08:37:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:37:30.612014 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed530086-6910-4bc2-a42b-7882b2f704f0 None None] REQUEST_METHOD: `POST` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:37:30.612495 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed530086-6910-4bc2-a42b-7882b2f704f0 None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:37:30.612632 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed530086-6910-4bc2-a42b-7882b2f704f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:37:30.632532 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.auth.core [None req-ed530086-6910-4bc2-a42b-7882b2f704f0 None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:37:30.633781 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.fernet_utils [None req-ed530086-6910-4bc2-a42b-7882b2f704f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:37:30.642446 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 573/1146] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 08:37:30 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 08:37:30.680906 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e490fbd-5f01-413e-b666-246fcf4c5d33 None None] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:37:30.682664 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.fernet_utils [None req-8e490fbd-5f01-413e-b666-246fcf4c5d33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:37:30.708479 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:37:30.762180 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e490fbd-5f01-413e-b666-246fcf4c5d33 None None] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:37:30.766249 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4be48fc-f26f-46a7-8be5-42598a6a4359 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56934ba9afb741679e0573167d6825f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '256f4731060449f1b80067e51e8bec00', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:37:30.767011 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4be48fc-f26f-46a7-8be5-42598a6a4359 service neutron] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:37:30.767405 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4be48fc-f26f-46a7-8be5-42598a6a4359 service neutron] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:37:30.767788 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4be48fc-f26f-46a7-8be5-42598a6a4359 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:37:30.778242 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4be48fc-f26f-46a7-8be5-42598a6a4359 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:37:30.779715 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4be48fc-f26f-46a7-8be5-42598a6a4359 service neutron] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:37:30.790257 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 574/1147] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 08:37:30 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 08:37:33.186508 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18b29b7-7ea3-4720-829b-86d0235a787b None None] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:37:33.187098 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18b29b7-7ea3-4720-829b-86d0235a787b None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:37:33.187098 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18b29b7-7ea3-4720-829b-86d0235a787b None None] PATH_INFO: `/` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:37:33.188457 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 574/1148] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 08:37:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:37:33.194575 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0ca243-d308-4a49-bf3e-cd354f25f69e None None] REQUEST_METHOD: `POST` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:37:33.195122 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0ca243-d308-4a49-bf3e-cd354f25f69e None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:37:33.195122 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0ca243-d308-4a49-bf3e-cd354f25f69e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:37:33.215215 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.auth.core [None req-0c0ca243-d308-4a49-bf3e-cd354f25f69e None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:37:33.216502 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.fernet_utils [None req-0c0ca243-d308-4a49-bf3e-cd354f25f69e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:37:33.225560 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 575/1149] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 08:37:33 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 08:37:33.270828 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18b29b7-7ea3-4720-829b-86d0235a787b None None] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:37:33.272691 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.fernet_utils [None req-a18b29b7-7ea3-4720-829b-86d0235a787b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:37:33.286462 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18b29b7-7ea3-4720-829b-86d0235a787b None None] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:37:33.290761 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dafa87-fdf9-4a51-8d2d-efc09262ee43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56934ba9afb741679e0573167d6825f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '256f4731060449f1b80067e51e8bec00', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:37:33.291400 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dafa87-fdf9-4a51-8d2d-efc09262ee43 service neutron] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:37:33.291682 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dafa87-fdf9-4a51-8d2d-efc09262ee43 service neutron] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:37:33.291956 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dafa87-fdf9-4a51-8d2d-efc09262ee43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:37:33.301951 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dafa87-fdf9-4a51-8d2d-efc09262ee43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:37:33.304667 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dafa87-fdf9-4a51-8d2d-efc09262ee43 service neutron] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:37:33.314679 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 575/1150] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 08:37:33 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 08:37:37.383872 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a0b219-193c-41e7-8bfc-639b20e0bd47 None None] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:37:37.384787 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a0b219-193c-41e7-8bfc-639b20e0bd47 None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:37:37.384787 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a0b219-193c-41e7-8bfc-639b20e0bd47 None None] PATH_INFO: `/` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:37:37.385840 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 576/1151] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 08:37:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:37:37.391813 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5330c408-f701-469f-9f2d-0957afa70311 None None] REQUEST_METHOD: `POST` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:37:37.392431 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5330c408-f701-469f-9f2d-0957afa70311 None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:37:37.392431 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5330c408-f701-469f-9f2d-0957afa70311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:37:37.419141 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.auth.core [None req-5330c408-f701-469f-9f2d-0957afa70311 None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:37:37.421048 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.fernet_utils [None req-5330c408-f701-469f-9f2d-0957afa70311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:37:37.430589 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 576/1152] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 08:37:37 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 08:37:37.718191 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a0b219-193c-41e7-8bfc-639b20e0bd47 None None] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:37:37.720052 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.fernet_utils [None req-20a0b219-193c-41e7-8bfc-639b20e0bd47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:37:37.805335 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a0b219-193c-41e7-8bfc-639b20e0bd47 None None] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:37:37.809269 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846fe75b-6e78-4b73-a239-a231b0b0dba9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839e73c51c5243b68335242a0d695842', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '256f4731060449f1b80067e51e8bec00', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:37:37.809981 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846fe75b-6e78-4b73-a239-a231b0b0dba9 service cinder] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:37:37.810382 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846fe75b-6e78-4b73-a239-a231b0b0dba9 service cinder] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:37:37.810724 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846fe75b-6e78-4b73-a239-a231b0b0dba9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:37:37.821893 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846fe75b-6e78-4b73-a239-a231b0b0dba9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:37:37.823387 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846fe75b-6e78-4b73-a239-a231b0b0dba9 service cinder] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:37:37.834748 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 577/1153] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 08:37:37 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 08:37:40.224522 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7802d334-dcaf-4237-b575-5f0617ad3562 None None] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:37:40.225371 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7802d334-dcaf-4237-b575-5f0617ad3562 None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:37:40.225560 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7802d334-dcaf-4237-b575-5f0617ad3562 None None] PATH_INFO: `/` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:37:40.226979 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 577/1154] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 27 08:37:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:37:40.232576 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0503cc2-e01d-439c-8b02-2aef6a6f3a82 None None] REQUEST_METHOD: `POST` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:37:40.233083 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0503cc2-e01d-439c-8b02-2aef6a6f3a82 None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:37:40.233193 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0503cc2-e01d-439c-8b02-2aef6a6f3a82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:37:40.254925 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.auth.core [None req-f0503cc2-e01d-439c-8b02-2aef6a6f3a82 None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:37:40.256831 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.fernet_utils [None req-f0503cc2-e01d-439c-8b02-2aef6a6f3a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:37:40.264680 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 578/1155] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 27 08:37:40 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 08:37:40.543307 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7802d334-dcaf-4237-b575-5f0617ad3562 None None] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:37:40.545036 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.fernet_utils [None req-7802d334-dcaf-4237-b575-5f0617ad3562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:37:40.559263 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7802d334-dcaf-4237-b575-5f0617ad3562 None None] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:37:40.562897 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8590e672-d1b5-463e-89e7-64c8edd3da2f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '839e73c51c5243b68335242a0d695842', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '256f4731060449f1b80067e51e8bec00', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:37:40.563539 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8590e672-d1b5-463e-89e7-64c8edd3da2f service cinder] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:37:40.563827 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8590e672-d1b5-463e-89e7-64c8edd3da2f service cinder] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:37:40.564136 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8590e672-d1b5-463e-89e7-64c8edd3da2f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:37:40.573353 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8590e672-d1b5-463e-89e7-64c8edd3da2f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:37:40.574830 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8590e672-d1b5-463e-89e7-64c8edd3da2f service cinder] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:37:40.584278 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 578/1156] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 08:37:40 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 08:37:50.249045 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=59 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:37:50.580043 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=33 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:39:01.319537 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8f9be7-cb31-4aa3-8c45-aa5c612e6b4c None None] REQUEST_METHOD: `POST` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:39:01.320182 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8f9be7-cb31-4aa3-8c45-aa5c612e6b4c None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:39:01.320182 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8f9be7-cb31-4aa3-8c45-aa5c612e6b4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:39:01.340004 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.auth.core [None req-2e8f9be7-cb31-4aa3-8c45-aa5c612e6b4c None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:39:01.340537 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6928117-9f11-40ef-8331-472dd751577a None None] REQUEST_METHOD: `POST` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:39:01.341145 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6928117-9f11-40ef-8331-472dd751577a None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:39:01.341145 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6928117-9f11-40ef-8331-472dd751577a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:39:01.341484 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.fernet_utils [None req-2e8f9be7-cb31-4aa3-8c45-aa5c612e6b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:39:01.350276 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 579/1157] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 08:39:01 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 08:39:01.360166 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73598c98-a29f-4678-bf00-d145bcc8ac0b None None] REQUEST_METHOD: `POST` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:39:01.360457 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73598c98-a29f-4678-bf00-d145bcc8ac0b None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:39:01.360776 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73598c98-a29f-4678-bf00-d145bcc8ac0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:39:01.361101 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.auth.core [None req-c6928117-9f11-40ef-8331-472dd751577a None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:39:01.363130 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.fernet_utils [None req-c6928117-9f11-40ef-8331-472dd751577a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:39:01.371603 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 579/1158] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 08:39:01 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 08:39:01.381513 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a7ddef-75ff-4b7b-90b5-df9622d228b0 None None] REQUEST_METHOD: `POST` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:39:01.381822 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a7ddef-75ff-4b7b-90b5-df9622d228b0 None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:39:01.382084 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a7ddef-75ff-4b7b-90b5-df9622d228b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:39:01.382358 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.auth.core [None req-73598c98-a29f-4678-bf00-d145bcc8ac0b None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:39:01.383604 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.fernet_utils [None req-73598c98-a29f-4678-bf00-d145bcc8ac0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:39:01.391711 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 580/1159] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 08:39:01 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 08:39:01.396769 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73598c98-a29f-4678-bf00-d145bcc8ac0b None None] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:39:01.401440 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.auth.core [None req-c0a7ddef-75ff-4b7b-90b5-df9622d228b0 None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:39:01.402672 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.fernet_utils [None req-c0a7ddef-75ff-4b7b-90b5-df9622d228b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:39:01.406075 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73598c98-a29f-4678-bf00-d145bcc8ac0b None None] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:39:01.411320 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f04b086-9024-4e73-b226-e4e3414b5db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db9f476e682c4ed795ebf3f955e975c9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:39:01.411818 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 580/1160] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 08:39:01 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 08:39:01.412179 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f04b086-9024-4e73-b226-e4e3414b5db1 admin admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:39:01.412498 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f04b086-9024-4e73-b226-e4e3414b5db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:39:01.412818 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f04b086-9024-4e73-b226-e4e3414b5db1 admin admin] PATH_INFO: `/v3/domains` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:39:01.413564 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f04b086-9024-4e73-b226-e4e3414b5db1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87173) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:39:01.413875 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f04b086-9024-4e73-b226-e4e3414b5db1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:39:01.415659 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f04b086-9024-4e73-b226-e4e3414b5db1 admin admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:39:01.416579 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a7ddef-75ff-4b7b-90b5-df9622d228b0 None None] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:39:01.429464 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a7ddef-75ff-4b7b-90b5-df9622d228b0 None None] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:39:01.431781 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 581/1161] 10.222.0.62 () {58 vars in 1152 bytes} [Fri May 27 08:39:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 27 08:39:01.432484 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47485904-dffb-4602-aec3-0aacbca2f077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db9f476e682c4ed795ebf3f955e975c9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:39:01.432484 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47485904-dffb-4602-aec3-0aacbca2f077 admin admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:39:01.432731 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47485904-dffb-4602-aec3-0aacbca2f077 admin admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:39:01.433040 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47485904-dffb-4602-aec3-0aacbca2f077 admin admin] PATH_INFO: `/v3/domains` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:39:01.433617 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47485904-dffb-4602-aec3-0aacbca2f077 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87172) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 27 08:39:01.433948 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47485904-dffb-4602-aec3-0aacbca2f077 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:39:01.434997 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: WARNING py.warnings [None req-47485904-dffb-4602-aec3-0aacbca2f077 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 08:39:01.434997 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: warnings.warn(msg) May 27 08:39:01.434997 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: May 27 08:39:01.437715 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47485904-dffb-4602-aec3-0aacbca2f077 admin admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:39:01.437864 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f04b086-9024-4e73-b226-e4e3414b5db1 admin admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:39:01.447892 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f04b086-9024-4e73-b226-e4e3414b5db1 admin admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:39:01.452358 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 581/1162] 10.222.0.62 () {58 vars in 1152 bytes} [Fri May 27 08:39:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 27 08:39:01.456896 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c062001-27ca-420a-a7c6-e676f779a04d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db9f476e682c4ed795ebf3f955e975c9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:39:01.457465 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47485904-dffb-4602-aec3-0aacbca2f077 admin admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:39:01.457571 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c062001-27ca-420a-a7c6-e676f779a04d admin admin] REQUEST_METHOD: `POST` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:39:01.457845 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c062001-27ca-420a-a7c6-e676f779a04d admin admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:39:01.458122 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c062001-27ca-420a-a7c6-e676f779a04d admin admin] PATH_INFO: `/v3/projects` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:39:01.458831 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c062001-27ca-420a-a7c6-e676f779a04d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:39:01.459887 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: WARNING py.warnings [None req-3c062001-27ca-420a-a7c6-e676f779a04d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 27 08:39:01.459887 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: warnings.warn(msg) May 27 08:39:01.459887 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: May 27 08:39:01.461133 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c062001-27ca-420a-a7c6-e676f779a04d admin admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:39:01.468061 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47485904-dffb-4602-aec3-0aacbca2f077 admin admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:39:01.473413 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e23d9d2-68be-4069-9c4e-3d07f8853e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db9f476e682c4ed795ebf3f955e975c9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:39:01.474066 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e23d9d2-68be-4069-9c4e-3d07f8853e5f admin admin] REQUEST_METHOD: `POST` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:39:01.474348 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e23d9d2-68be-4069-9c4e-3d07f8853e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:39:01.474625 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e23d9d2-68be-4069-9c4e-3d07f8853e5f admin admin] PATH_INFO: `/v3/projects` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:39:01.475321 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e23d9d2-68be-4069-9c4e-3d07f8853e5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:39:01.477258 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e23d9d2-68be-4069-9c4e-3d07f8853e5f admin admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:39:01.489799 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 582/1163] 10.222.0.62 () {60 vars in 1152 bytes} [Fri May 27 08:39:01 2022] POST /identity/v3/projects => generated 379 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 08:39:01.493964 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c062001-27ca-420a-a7c6-e676f779a04d admin admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:39:01.508182 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 582/1164] 10.222.0.62 () {60 vars in 1152 bytes} [Fri May 27 08:39:01 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 08:39:01.512209 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e23d9d2-68be-4069-9c4e-3d07f8853e5f admin admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:39:01.560726 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c062001-27ca-420a-a7c6-e676f779a04d admin admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:39:01.575714 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e23d9d2-68be-4069-9c4e-3d07f8853e5f admin admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:39:01.580369 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aaca45-1de4-4ad5-b9af-942923e8b0f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db9f476e682c4ed795ebf3f955e975c9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:39:01.581574 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aaca45-1de4-4ad5-b9af-942923e8b0f4 admin admin] REQUEST_METHOD: `POST` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:39:01.581907 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aaca45-1de4-4ad5-b9af-942923e8b0f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:39:01.582238 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aaca45-1de4-4ad5-b9af-942923e8b0f4 admin admin] PATH_INFO: `/v3/users` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:39:01.582944 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35aaca45-1de4-4ad5-b9af-942923e8b0f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:39:01.583969 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: WARNING py.warnings [None req-35aaca45-1de4-4ad5-b9af-942923e8b0f4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 27 08:39:01.583969 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: warnings.warn(msg) May 27 08:39:01.583969 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: May 27 08:39:01.585545 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35aaca45-1de4-4ad5-b9af-942923e8b0f4 admin admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:39:01.606539 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 583/1165] 10.222.0.62 () {60 vars in 1143 bytes} [Fri May 27 08:39:01 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 08:39:01.610511 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aaca45-1de4-4ad5-b9af-942923e8b0f4 admin admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:39:01.621226 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aaca45-1de4-4ad5-b9af-942923e8b0f4 admin admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:39:01.626204 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933b094e-8a62-4d81-9d3e-1082b3e39a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db9f476e682c4ed795ebf3f955e975c9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:39:01.626703 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06baf68c-46af-4d7b-9ce7-8a0b0e0cb865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db9f476e682c4ed795ebf3f955e975c9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:39:01.627016 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933b094e-8a62-4d81-9d3e-1082b3e39a6e admin admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:39:01.627342 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933b094e-8a62-4d81-9d3e-1082b3e39a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:39:01.627515 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06baf68c-46af-4d7b-9ce7-8a0b0e0cb865 admin admin] REQUEST_METHOD: `POST` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:39:01.627709 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933b094e-8a62-4d81-9d3e-1082b3e39a6e admin admin] PATH_INFO: `/v3/roles` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:39:01.627907 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06baf68c-46af-4d7b-9ce7-8a0b0e0cb865 admin admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:39:01.628114 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06baf68c-46af-4d7b-9ce7-8a0b0e0cb865 admin admin] PATH_INFO: `/v3/users` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:39:01.628349 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933b094e-8a62-4d81-9d3e-1082b3e39a6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:39:01.628818 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06baf68c-46af-4d7b-9ce7-8a0b0e0cb865 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:39:01.630019 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933b094e-8a62-4d81-9d3e-1082b3e39a6e admin admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:39:01.630750 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06baf68c-46af-4d7b-9ce7-8a0b0e0cb865 admin admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:39:01.644432 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 584/1166] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 08:39:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 08:39:01.647137 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933b094e-8a62-4d81-9d3e-1082b3e39a6e admin admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:39:01.659897 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 583/1167] 10.222.0.62 () {60 vars in 1143 bytes} [Fri May 27 08:39:01 2022] POST /identity/v3/users => generated 290 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 08:39:01.660078 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933b094e-8a62-4d81-9d3e-1082b3e39a6e admin admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:39:01.661394 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06baf68c-46af-4d7b-9ce7-8a0b0e0cb865 admin admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:39:01.662055 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714396e7-dc81-4462-929a-e37a1fc45fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db9f476e682c4ed795ebf3f955e975c9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:39:01.662716 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714396e7-dc81-4462-929a-e37a1fc45fdf admin admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:39:01.663000 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714396e7-dc81-4462-929a-e37a1fc45fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:39:01.663275 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714396e7-dc81-4462-929a-e37a1fc45fdf admin admin] PATH_INFO: `/v3/roles` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:39:01.663997 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714396e7-dc81-4462-929a-e37a1fc45fdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:39:01.665660 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714396e7-dc81-4462-929a-e37a1fc45fdf admin admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:39:01.671485 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06baf68c-46af-4d7b-9ce7-8a0b0e0cb865 admin admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:39:01.678495 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87fabed-e194-4ac4-b12a-2bb992d1b589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db9f476e682c4ed795ebf3f955e975c9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:39:01.679175 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87fabed-e194-4ac4-b12a-2bb992d1b589 admin admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:39:01.679485 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87fabed-e194-4ac4-b12a-2bb992d1b589 admin admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:39:01.679766 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87fabed-e194-4ac4-b12a-2bb992d1b589 admin admin] PATH_INFO: `/v3/roles` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:39:01.679917 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 585/1168] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 08:39:01 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 08:39:01.680541 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87fabed-e194-4ac4-b12a-2bb992d1b589 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:39:01.682204 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87fabed-e194-4ac4-b12a-2bb992d1b589 admin admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:39:01.684263 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714396e7-dc81-4462-929a-e37a1fc45fdf admin admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:39:01.693807 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 584/1169] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 08:39:01 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 08:39:01.695668 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714396e7-dc81-4462-929a-e37a1fc45fdf admin admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:39:01.697698 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87fabed-e194-4ac4-b12a-2bb992d1b589 admin admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:39:01.700527 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b67272-3887-4054-9387-0aa84bce7c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db9f476e682c4ed795ebf3f955e975c9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:39:01.701451 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b67272-3887-4054-9387-0aa84bce7c9a admin admin] REQUEST_METHOD: `PUT` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:39:01.701735 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b67272-3887-4054-9387-0aa84bce7c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:39:01.702015 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b67272-3887-4054-9387-0aa84bce7c9a admin admin] PATH_INFO: `/v3/projects/34fbac72851c4325bac2829ba238a1bd/users/6fe3eb41f0e445e59ad220eda1ac9b20/roles/c980c64bb84b418daa012ae45a054b37` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:39:01.707581 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87fabed-e194-4ac4-b12a-2bb992d1b589 admin admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:39:01.712291 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97d917c-2a23-47f3-a9b0-a6ecd945ba85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db9f476e682c4ed795ebf3f955e975c9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:39:01.712970 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97d917c-2a23-47f3-a9b0-a6ecd945ba85 admin admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:39:01.713257 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97d917c-2a23-47f3-a9b0-a6ecd945ba85 admin admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:39:01.713537 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97d917c-2a23-47f3-a9b0-a6ecd945ba85 admin admin] PATH_INFO: `/v3/roles` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:39:01.714253 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97d917c-2a23-47f3-a9b0-a6ecd945ba85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:39:01.715865 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97d917c-2a23-47f3-a9b0-a6ecd945ba85 admin admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:39:01.717258 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b67272-3887-4054-9387-0aa84bce7c9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=34fbac72851c4325bac2829ba238a1bd, user_id=6fe3eb41f0e445e59ad220eda1ac9b20, role_id=c980c64bb84b418daa012ae45a054b37)` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:39:01.719951 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b67272-3887-4054-9387-0aa84bce7c9a admin admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:39:01.726699 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 585/1170] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 08:39:01 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 08:39:01.730967 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97d917c-2a23-47f3-a9b0-a6ecd945ba85 admin admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:39:01.735160 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 586/1171] 10.222.0.62 () {60 vars in 1482 bytes} [Fri May 27 08:39:01 2022] PUT /identity/v3/projects/34fbac72851c4325bac2829ba238a1bd/users/6fe3eb41f0e445e59ad220eda1ac9b20/roles/c980c64bb84b418daa012ae45a054b37 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 08:39:01.740671 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f456da-d0d0-4805-89eb-d98c86084859 None None] REQUEST_METHOD: `POST` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:39:01.740969 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f456da-d0d0-4805-89eb-d98c86084859 None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:39:01.741251 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f456da-d0d0-4805-89eb-d98c86084859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:39:01.741881 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97d917c-2a23-47f3-a9b0-a6ecd945ba85 admin admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:39:01.759361 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.auth.core [None req-44f456da-d0d0-4805-89eb-d98c86084859 None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:39:01.760613 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.fernet_utils [None req-44f456da-d0d0-4805-89eb-d98c86084859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:39:01.767301 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:39:01.802657 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef169ffb-fcb8-4d38-b842-c39fb347e07d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db9f476e682c4ed795ebf3f955e975c9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:39:01.803565 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef169ffb-fcb8-4d38-b842-c39fb347e07d admin admin] REQUEST_METHOD: `PUT` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:39:01.803854 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef169ffb-fcb8-4d38-b842-c39fb347e07d admin admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:39:01.804134 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef169ffb-fcb8-4d38-b842-c39fb347e07d admin admin] PATH_INFO: `/v3/projects/35985dbf06f84514b54e2f86e9a25802/users/54110041d43d4a4c909c3404190f5f7f/roles/c980c64bb84b418daa012ae45a054b37` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:39:01.810710 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:39:01.820488 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef169ffb-fcb8-4d38-b842-c39fb347e07d admin admin] RBAC: Authorizing `identity:create_grant(project_id=35985dbf06f84514b54e2f86e9a25802, user_id=54110041d43d4a4c909c3404190f5f7f, role_id=c980c64bb84b418daa012ae45a054b37)` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:39:01.821595 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: WARNING py.warnings [None req-ef169ffb-fcb8-4d38-b842-c39fb347e07d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 27 08:39:01.821595 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: warnings.warn(msg) May 27 08:39:01.821595 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: May 27 08:39:01.823743 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef169ffb-fcb8-4d38-b842-c39fb347e07d admin admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:39:01.824352 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 587/1172] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 08:39:01 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 08:39:01.838491 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f456da-d0d0-4805-89eb-d98c86084859 None None] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:39:01.844679 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 586/1173] 10.222.0.62 () {60 vars in 1482 bytes} [Fri May 27 08:39:01 2022] PUT /identity/v3/projects/35985dbf06f84514b54e2f86e9a25802/users/54110041d43d4a4c909c3404190f5f7f/roles/c980c64bb84b418daa012ae45a054b37 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 08:39:01.850762 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06bd913-3f55-467d-89e8-98ccf9924167 None None] REQUEST_METHOD: `POST` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:39:01.851069 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06bd913-3f55-467d-89e8-98ccf9924167 None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:39:01.851354 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06bd913-3f55-467d-89e8-98ccf9924167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:39:01.870097 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.auth.core [None req-e06bd913-3f55-467d-89e8-98ccf9924167 None None] MFA Rules not processed for user `ca179b0a3ab4467ba61f4e713c6eb763`. Rule list: `[]` (Enabled: `True`). {{(pid=87173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:39:01.871262 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.fernet_utils [None req-e06bd913-3f55-467d-89e8-98ccf9924167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:39:01.903687 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f456da-d0d0-4805-89eb-d98c86084859 None None] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:39:01.941968 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 587/1174] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 08:39:01 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 08:39:01.952748 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06bd913-3f55-467d-89e8-98ccf9924167 None None] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:39:01.969202 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca9f425-9226-444e-af3e-483eb4ae54b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56934ba9afb741679e0573167d6825f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '256f4731060449f1b80067e51e8bec00', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:39:01.969865 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca9f425-9226-444e-af3e-483eb4ae54b7 service neutron] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:39:01.970147 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca9f425-9226-444e-af3e-483eb4ae54b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:39:01.970420 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca9f425-9226-444e-af3e-483eb4ae54b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:39:01.980977 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca9f425-9226-444e-af3e-483eb4ae54b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:39:01.982424 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca9f425-9226-444e-af3e-483eb4ae54b7 service neutron] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:39:01.994296 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 588/1175] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 08:39:01 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 08:39:02.011197 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06bd913-3f55-467d-89e8-98ccf9924167 None None] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:39:02.015301 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee53853-a250-49b4-910f-7e1b2d811f98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56934ba9afb741679e0573167d6825f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '256f4731060449f1b80067e51e8bec00', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:39:02.015978 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee53853-a250-49b4-910f-7e1b2d811f98 service neutron] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:39:02.016415 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee53853-a250-49b4-910f-7e1b2d811f98 service neutron] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:39:02.016731 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee53853-a250-49b4-910f-7e1b2d811f98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:39:02.029553 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee53853-a250-49b4-910f-7e1b2d811f98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:39:02.031213 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee53853-a250-49b4-910f-7e1b2d811f98 service neutron] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:39:02.042871 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 588/1176] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 08:39:01 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 08:39:07.912086 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6780011a-36b7-4fc4-93b9-7c0941c46527 None None] REQUEST_METHOD: `POST` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:39:07.912889 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6780011a-36b7-4fc4-93b9-7c0941c46527 None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:39:07.912889 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6780011a-36b7-4fc4-93b9-7c0941c46527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:39:08.022226 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.auth.core [None req-6780011a-36b7-4fc4-93b9-7c0941c46527 None None] MFA Rules not processed for user `6fe3eb41f0e445e59ad220eda1ac9b20`. Rule list: `[]` (Enabled: `True`). {{(pid=87172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:39:08.024717 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.fernet_utils [None req-6780011a-36b7-4fc4-93b9-7c0941c46527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:39:08.166269 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 589/1177] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 08:39:07 2022] POST /identity/v3/auth/tokens => generated 2812 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 08:39:08.167210 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee53853-a250-49b4-910f-7e1b2d811f98 service neutron] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:39:08.179539 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee53853-a250-49b4-910f-7e1b2d811f98 service neutron] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:39:08.186702 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb2126c-8724-4e27-aaf3-787c69608d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db9f476e682c4ed795ebf3f955e975c9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:39:08.187874 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb2126c-8724-4e27-aaf3-787c69608d30 admin admin] REQUEST_METHOD: `POST` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:39:08.188227 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb2126c-8724-4e27-aaf3-787c69608d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:39:08.188620 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb2126c-8724-4e27-aaf3-787c69608d30 admin admin] PATH_INFO: `/v3/projects` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:39:08.189679 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb2126c-8724-4e27-aaf3-787c69608d30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:39:08.192677 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb2126c-8724-4e27-aaf3-787c69608d30 admin admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:39:08.237606 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 589/1178] 10.222.0.62 () {60 vars in 1152 bytes} [Fri May 27 08:39:08 2022] POST /identity/v3/projects => generated 385 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 08:39:08.239470 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6780011a-36b7-4fc4-93b9-7c0941c46527 None None] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:39:08.262925 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6780011a-36b7-4fc4-93b9-7c0941c46527 None None] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:39:08.339353 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:39:08.368020 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de28351-3c4a-44a3-bbb8-d36b927f592c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db9f476e682c4ed795ebf3f955e975c9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:39:08.368825 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de28351-3c4a-44a3-bbb8-d36b927f592c admin admin] REQUEST_METHOD: `POST` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:39:08.369111 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de28351-3c4a-44a3-bbb8-d36b927f592c admin admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:39:08.369388 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de28351-3c4a-44a3-bbb8-d36b927f592c admin admin] PATH_INFO: `/v3/users` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:39:08.370119 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de28351-3c4a-44a3-bbb8-d36b927f592c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:39:08.372189 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de28351-3c4a-44a3-bbb8-d36b927f592c admin admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:39:08.403538 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 590/1179] 10.222.0.62 () {60 vars in 1143 bytes} [Fri May 27 08:39:08 2022] POST /identity/v3/users => generated 299 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 08:39:08.408038 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb2126c-8724-4e27-aaf3-787c69608d30 admin admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:39:08.426314 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb2126c-8724-4e27-aaf3-787c69608d30 admin admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:39:08.431921 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8358dbfa-2d59-4f7e-a3dc-30cbd557f583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db9f476e682c4ed795ebf3f955e975c9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:39:08.433607 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8358dbfa-2d59-4f7e-a3dc-30cbd557f583 admin admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:39:08.433975 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8358dbfa-2d59-4f7e-a3dc-30cbd557f583 admin admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:39:08.434382 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8358dbfa-2d59-4f7e-a3dc-30cbd557f583 admin admin] PATH_INFO: `/v3/roles` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:39:08.435191 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8358dbfa-2d59-4f7e-a3dc-30cbd557f583 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:39:08.438661 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8358dbfa-2d59-4f7e-a3dc-30cbd557f583 admin admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:39:08.458947 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 590/1180] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 08:39:08 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 27 08:39:08.463852 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de28351-3c4a-44a3-bbb8-d36b927f592c admin admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:39:08.480651 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de28351-3c4a-44a3-bbb8-d36b927f592c admin admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:39:08.489582 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264574cc-0c92-4504-95c7-f7378762576e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db9f476e682c4ed795ebf3f955e975c9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:39:08.491465 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264574cc-0c92-4504-95c7-f7378762576e admin admin] REQUEST_METHOD: `PUT` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:39:08.491722 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264574cc-0c92-4504-95c7-f7378762576e admin admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:39:08.492001 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264574cc-0c92-4504-95c7-f7378762576e admin admin] PATH_INFO: `/v3/projects/535097420f19472dac36431bfa3b0c64/users/b07a5cea4a2c41f3856c3143ccad5f16/roles/5e6f243a7201412c965e7c70249d4dc0` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:39:08.526936 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264574cc-0c92-4504-95c7-f7378762576e admin admin] RBAC: Authorizing `identity:create_grant(project_id=535097420f19472dac36431bfa3b0c64, user_id=b07a5cea4a2c41f3856c3143ccad5f16, role_id=5e6f243a7201412c965e7c70249d4dc0)` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:39:08.530263 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264574cc-0c92-4504-95c7-f7378762576e admin admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:39:08.562798 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 591/1181] 10.222.0.62 () {60 vars in 1482 bytes} [Fri May 27 08:39:08 2022] PUT /identity/v3/projects/535097420f19472dac36431bfa3b0c64/users/b07a5cea4a2c41f3856c3143ccad5f16/roles/5e6f243a7201412c965e7c70249d4dc0 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 08:39:08.567067 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8358dbfa-2d59-4f7e-a3dc-30cbd557f583 admin admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:39:08.599118 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8358dbfa-2d59-4f7e-a3dc-30cbd557f583 admin admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:39:08.653613 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:39:08.756670 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f547cd9-f010-4296-9fce-a62a16207745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db9f476e682c4ed795ebf3f955e975c9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:39:08.757644 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f547cd9-f010-4296-9fce-a62a16207745 admin admin] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:39:08.758087 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f547cd9-f010-4296-9fce-a62a16207745 admin admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:39:08.758578 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f547cd9-f010-4296-9fce-a62a16207745 admin admin] PATH_INFO: `/v3/roles` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:39:08.759770 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f547cd9-f010-4296-9fce-a62a16207745 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:39:08.761728 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f547cd9-f010-4296-9fce-a62a16207745 admin admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:39:08.785195 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 591/1182] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 08:39:08 2022] GET /identity/v3/roles => generated 1420 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 08:39:08.790303 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264574cc-0c92-4504-95c7-f7378762576e admin admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:39:08.807659 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264574cc-0c92-4504-95c7-f7378762576e admin admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:39:08.827049 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec86e7e-a386-4df3-a198-94248adc9a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db9f476e682c4ed795ebf3f955e975c9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:39:08.828477 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec86e7e-a386-4df3-a198-94248adc9a87 admin admin] REQUEST_METHOD: `PUT` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:39:08.829084 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec86e7e-a386-4df3-a198-94248adc9a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:39:08.829531 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec86e7e-a386-4df3-a198-94248adc9a87 admin admin] PATH_INFO: `/v3/projects/535097420f19472dac36431bfa3b0c64/users/b07a5cea4a2c41f3856c3143ccad5f16/roles/5e6f243a7201412c965e7c70249d4dc0` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:39:08.832740 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec86e7e-a386-4df3-a198-94248adc9a87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=535097420f19472dac36431bfa3b0c64, user_id=b07a5cea4a2c41f3856c3143ccad5f16, role_id=5e6f243a7201412c965e7c70249d4dc0)` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:39:08.835753 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec86e7e-a386-4df3-a198-94248adc9a87 admin admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:39:08.856228 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 592/1183] 10.222.0.62 () {60 vars in 1482 bytes} [Fri May 27 08:39:08 2022] PUT /identity/v3/projects/535097420f19472dac36431bfa3b0c64/users/b07a5cea4a2c41f3856c3143ccad5f16/roles/5e6f243a7201412c965e7c70249d4dc0 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 08:39:08.980818 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec64ede1-0069-4b99-830c-bac59096dea4 None None] REQUEST_METHOD: `POST` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:39:08.981470 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec64ede1-0069-4b99-830c-bac59096dea4 None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:39:08.982190 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec64ede1-0069-4b99-830c-bac59096dea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:39:09.027215 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.auth.core [None req-ec64ede1-0069-4b99-830c-bac59096dea4 None None] MFA Rules not processed for user `54110041d43d4a4c909c3404190f5f7f`. Rule list: `[]` (Enabled: `True`). {{(pid=87173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:39:09.029609 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.fernet_utils [None req-ec64ede1-0069-4b99-830c-bac59096dea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:39:09.176483 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 592/1184] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 08:39:08 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 08:39:09.181285 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec86e7e-a386-4df3-a198-94248adc9a87 admin admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:39:09.280166 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec86e7e-a386-4df3-a198-94248adc9a87 admin admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:39:09.287194 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84800c7a-6186-40fc-858f-ee4d7e4b8839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db9f476e682c4ed795ebf3f955e975c9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:39:09.287417 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84800c7a-6186-40fc-858f-ee4d7e4b8839 admin admin] REQUEST_METHOD: `POST` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:39:09.287715 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84800c7a-6186-40fc-858f-ee4d7e4b8839 admin admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:39:09.287950 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84800c7a-6186-40fc-858f-ee4d7e4b8839 admin admin] PATH_INFO: `/v3/projects` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:39:09.288786 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84800c7a-6186-40fc-858f-ee4d7e4b8839 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:39:09.290836 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84800c7a-6186-40fc-858f-ee4d7e4b8839 admin admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:39:09.352921 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 593/1185] 10.222.0.62 () {60 vars in 1152 bytes} [Fri May 27 08:39:09 2022] POST /identity/v3/projects => generated 377 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 27 08:39:09.357385 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec64ede1-0069-4b99-830c-bac59096dea4 None None] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:39:09.373233 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec64ede1-0069-4b99-830c-bac59096dea4 None None] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:39:09.459852 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed44799-2721-478e-9b52-a020163adc3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db9f476e682c4ed795ebf3f955e975c9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:39:09.461004 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed44799-2721-478e-9b52-a020163adc3f admin admin] REQUEST_METHOD: `POST` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:39:09.461298 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed44799-2721-478e-9b52-a020163adc3f admin admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:39:09.461887 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed44799-2721-478e-9b52-a020163adc3f admin admin] PATH_INFO: `/v3/users` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:39:09.462686 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed44799-2721-478e-9b52-a020163adc3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:39:09.466482 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed44799-2721-478e-9b52-a020163adc3f admin admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:39:09.509071 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 593/1186] 10.222.0.62 () {60 vars in 1143 bytes} [Fri May 27 08:39:09 2022] POST /identity/v3/users => generated 295 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 27 08:39:09.513074 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84800c7a-6186-40fc-858f-ee4d7e4b8839 admin admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:39:09.525379 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84800c7a-6186-40fc-858f-ee4d7e4b8839 admin admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:39:09.535954 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f48206c-0b0f-4081-a951-35bd22beddb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db9f476e682c4ed795ebf3f955e975c9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:39:09.535954 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f48206c-0b0f-4081-a951-35bd22beddb5 admin admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:39:09.535954 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f48206c-0b0f-4081-a951-35bd22beddb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:39:09.535954 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f48206c-0b0f-4081-a951-35bd22beddb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:39:09.537310 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f48206c-0b0f-4081-a951-35bd22beddb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:39:09.538910 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f48206c-0b0f-4081-a951-35bd22beddb5 admin admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:39:09.554794 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 594/1187] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 08:39:09 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 08:39:09.559652 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed44799-2721-478e-9b52-a020163adc3f admin admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:39:09.576120 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed44799-2721-478e-9b52-a020163adc3f admin admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:39:09.585573 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761aa576-2d85-47b5-81d7-580f54000e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db9f476e682c4ed795ebf3f955e975c9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:39:09.586966 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761aa576-2d85-47b5-81d7-580f54000e22 admin admin] REQUEST_METHOD: `PUT` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:39:09.587197 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761aa576-2d85-47b5-81d7-580f54000e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:39:09.587579 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761aa576-2d85-47b5-81d7-580f54000e22 admin admin] PATH_INFO: `/v3/projects/72cc073e50e841dbbdd445ba2a4f8256/users/d244e3d27f3641c7b6f35710568bb69d/roles/5e6f243a7201412c965e7c70249d4dc0` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:39:09.607232 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761aa576-2d85-47b5-81d7-580f54000e22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72cc073e50e841dbbdd445ba2a4f8256, user_id=d244e3d27f3641c7b6f35710568bb69d, role_id=5e6f243a7201412c965e7c70249d4dc0)` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:39:09.610310 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761aa576-2d85-47b5-81d7-580f54000e22 admin admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:39:09.639211 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 594/1188] 10.222.0.62 () {60 vars in 1482 bytes} [Fri May 27 08:39:09 2022] PUT /identity/v3/projects/72cc073e50e841dbbdd445ba2a4f8256/users/d244e3d27f3641c7b6f35710568bb69d/roles/5e6f243a7201412c965e7c70249d4dc0 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 08:39:09.644893 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f48206c-0b0f-4081-a951-35bd22beddb5 admin admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:39:09.661513 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f48206c-0b0f-4081-a951-35bd22beddb5 admin admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:39:09.761980 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3600825a-78e2-480b-a1ba-e2d4ca3cbb4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db9f476e682c4ed795ebf3f955e975c9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:39:09.762764 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3600825a-78e2-480b-a1ba-e2d4ca3cbb4d admin admin] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:39:09.763556 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3600825a-78e2-480b-a1ba-e2d4ca3cbb4d admin admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:39:09.763556 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3600825a-78e2-480b-a1ba-e2d4ca3cbb4d admin admin] PATH_INFO: `/v3/roles` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:39:09.764395 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3600825a-78e2-480b-a1ba-e2d4ca3cbb4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:39:09.767357 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3600825a-78e2-480b-a1ba-e2d4ca3cbb4d admin admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:39:09.798079 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 595/1189] 10.222.0.62 () {58 vars in 1121 bytes} [Fri May 27 08:39:09 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 27 08:39:09.805494 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761aa576-2d85-47b5-81d7-580f54000e22 admin admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:39:09.822618 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761aa576-2d85-47b5-81d7-580f54000e22 admin admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:39:09.829723 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea9b175-ff42-4f9a-bdd8-67d76a2d8ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db9f476e682c4ed795ebf3f955e975c9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:39:09.831563 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea9b175-ff42-4f9a-bdd8-67d76a2d8ce4 admin admin] REQUEST_METHOD: `PUT` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:39:09.832080 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea9b175-ff42-4f9a-bdd8-67d76a2d8ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:39:09.832692 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea9b175-ff42-4f9a-bdd8-67d76a2d8ce4 admin admin] PATH_INFO: `/v3/projects/72cc073e50e841dbbdd445ba2a4f8256/users/d244e3d27f3641c7b6f35710568bb69d/roles/5e6f243a7201412c965e7c70249d4dc0` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:39:09.835315 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea9b175-ff42-4f9a-bdd8-67d76a2d8ce4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72cc073e50e841dbbdd445ba2a4f8256, user_id=d244e3d27f3641c7b6f35710568bb69d, role_id=5e6f243a7201412c965e7c70249d4dc0)` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:39:09.838518 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea9b175-ff42-4f9a-bdd8-67d76a2d8ce4 admin admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:39:09.851901 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:39:09.851901 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 595/1190] 10.222.0.62 () {60 vars in 1482 bytes} [Fri May 27 08:39:09 2022] PUT /identity/v3/projects/72cc073e50e841dbbdd445ba2a4f8256/users/d244e3d27f3641c7b6f35710568bb69d/roles/5e6f243a7201412c965e7c70249d4dc0 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 08:39:17.061615 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837f19e1-cfe0-4e5a-9b12-683e0df50cb0 None None] REQUEST_METHOD: `POST` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:39:17.062265 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837f19e1-cfe0-4e5a-9b12-683e0df50cb0 None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:39:17.062265 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837f19e1-cfe0-4e5a-9b12-683e0df50cb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:39:17.078849 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:39:17.100377 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.auth.core [None req-837f19e1-cfe0-4e5a-9b12-683e0df50cb0 None None] MFA Rules not processed for user `b07a5cea4a2c41f3856c3143ccad5f16`. Rule list: `[]` (Enabled: `True`). {{(pid=87172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:39:17.101865 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.fernet_utils [None req-837f19e1-cfe0-4e5a-9b12-683e0df50cb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:39:17.243946 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 596/1191] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 08:39:17 2022] POST /identity/v3/auth/tokens => generated 2879 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 08:39:17.273831 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea9b175-ff42-4f9a-bdd8-67d76a2d8ce4 admin admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:39:17.276082 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.fernet_utils [None req-8ea9b175-ff42-4f9a-bdd8-67d76a2d8ce4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:39:17.497019 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea9b175-ff42-4f9a-bdd8-67d76a2d8ce4 admin admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:39:17.505685 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd42bb9-6954-4dc5-9d76-e09267ce91f2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af5ebcf47654d08881584431b199416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '256f4731060449f1b80067e51e8bec00', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:39:17.507154 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd42bb9-6954-4dc5-9d76-e09267ce91f2 service glance] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:39:17.508085 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd42bb9-6954-4dc5-9d76-e09267ce91f2 service glance] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:39:17.508837 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd42bb9-6954-4dc5-9d76-e09267ce91f2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:39:17.604083 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd42bb9-6954-4dc5-9d76-e09267ce91f2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:39:17.605820 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd42bb9-6954-4dc5-9d76-e09267ce91f2 service glance] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:39:17.623508 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 596/1192] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 08:39:17 2022] GET /identity/v3/auth/tokens => generated 2812 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 08:39:18.504243 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81211c9f-df4c-4aec-aa82-7b9be65c82b1 None None] REQUEST_METHOD: `POST` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:39:18.504854 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81211c9f-df4c-4aec-aa82-7b9be65c82b1 None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:39:18.504854 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81211c9f-df4c-4aec-aa82-7b9be65c82b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:39:18.539988 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.auth.core [None req-81211c9f-df4c-4aec-aa82-7b9be65c82b1 None None] MFA Rules not processed for user `d244e3d27f3641c7b6f35710568bb69d`. Rule list: `[]` (Enabled: `True`). {{(pid=87172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:39:18.541214 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.fernet_utils [None req-81211c9f-df4c-4aec-aa82-7b9be65c82b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:39:18.678935 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 597/1193] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 08:39:18 2022] POST /identity/v3/auth/tokens => generated 2871 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 08:39:18.690275 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd42bb9-6954-4dc5-9d76-e09267ce91f2 service glance] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:39:18.712155 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd42bb9-6954-4dc5-9d76-e09267ce91f2 service glance] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:39:18.717934 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ce34a8-c2a0-4c88-a358-8c8edf8709f8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af5ebcf47654d08881584431b199416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '256f4731060449f1b80067e51e8bec00', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:39:18.718528 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ce34a8-c2a0-4c88-a358-8c8edf8709f8 service glance] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:39:18.718810 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ce34a8-c2a0-4c88-a358-8c8edf8709f8 service glance] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:39:18.719084 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ce34a8-c2a0-4c88-a358-8c8edf8709f8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:39:18.822209 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ce34a8-c2a0-4c88-a358-8c8edf8709f8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:39:18.823272 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ce34a8-c2a0-4c88-a358-8c8edf8709f8 service glance] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:39:18.851246 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 597/1194] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 08:39:18 2022] GET /identity/v3/auth/tokens => generated 2806 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 08:39:26.358739 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5802d5-6b5e-4428-ae53-135899b4b484 None None] REQUEST_METHOD: `POST` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:39:26.359356 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5802d5-6b5e-4428-ae53-135899b4b484 None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:39:26.359519 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5802d5-6b5e-4428-ae53-135899b4b484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:39:26.395179 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.auth.core [None req-8f5802d5-6b5e-4428-ae53-135899b4b484 None None] MFA Rules not processed for user `6fe3eb41f0e445e59ad220eda1ac9b20`. Rule list: `[]` (Enabled: `True`). {{(pid=87172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:39:26.397090 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.fernet_utils [None req-8f5802d5-6b5e-4428-ae53-135899b4b484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:39:26.408753 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 598/1195] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 08:39:26 2022] POST /identity/v3/auth/tokens => generated 2812 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 08:39:26.822291 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9f9548-2936-4b7d-8883-8eb8e2384c27 None None] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:39:26.822804 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9f9548-2936-4b7d-8883-8eb8e2384c27 None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:39:26.823537 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9f9548-2936-4b7d-8883-8eb8e2384c27 None None] PATH_INFO: `/` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:39:26.825710 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 598/1196] 10.222.0.62 () {54 vars in 961 bytes} [Fri May 27 08:39:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:39:26.835540 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7da1549-6191-4451-ab13-559fc8f7fd09 None None] REQUEST_METHOD: `POST` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:39:26.835827 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7da1549-6191-4451-ab13-559fc8f7fd09 None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:39:26.836152 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7da1549-6191-4451-ab13-559fc8f7fd09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:39:26.891151 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.auth.core [None req-e7da1549-6191-4451-ab13-559fc8f7fd09 None None] MFA Rules not processed for user `3a09bdc2dbac4f9abe450ff121e7dce8`. Rule list: `[]` (Enabled: `True`). {{(pid=87172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:39:26.893467 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.fernet_utils [None req-e7da1549-6191-4451-ab13-559fc8f7fd09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:39:26.998733 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=100 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:39:27.025024 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 599/1197] 10.222.0.62 () {58 vars in 1058 bytes} [Fri May 27 08:39:26 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 08:39:27.030644 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf48a71-6706-42b7-a46f-710fb37bb05e None None] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:39:27.030939 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf48a71-6706-42b7-a46f-710fb37bb05e None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:39:27.031218 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf48a71-6706-42b7-a46f-710fb37bb05e None None] PATH_INFO: `/` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:39:27.032794 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 599/1198] 10.222.0.62 () {54 vars in 912 bytes} [Fri May 27 08:39:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:39:27.038966 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2c1c00-f3a1-4917-ae13-857ff13baa8a None None] REQUEST_METHOD: `POST` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:39:27.039523 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2c1c00-f3a1-4917-ae13-857ff13baa8a None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:39:27.040265 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2c1c00-f3a1-4917-ae13-857ff13baa8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:39:27.064678 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.auth.core [None req-6c2c1c00-f3a1-4917-ae13-857ff13baa8a None None] MFA Rules not processed for user `3a09bdc2dbac4f9abe450ff121e7dce8`. Rule list: `[]` (Enabled: `True`). {{(pid=87172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:39:27.065963 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.fernet_utils [None req-6c2c1c00-f3a1-4917-ae13-857ff13baa8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:39:27.084410 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 600/1199] 10.222.0.62 () {58 vars in 1009 bytes} [Fri May 27 08:39:27 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 08:39:27.093548 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf48a71-6706-42b7-a46f-710fb37bb05e None None] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:39:27.096489 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.fernet_utils [None req-baf48a71-6706-42b7-a46f-710fb37bb05e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:39:27.117035 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf48a71-6706-42b7-a46f-710fb37bb05e None None] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:39:27.121298 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affd0ebc-71f9-480c-a1d0-13c60561616d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af5ebcf47654d08881584431b199416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '256f4731060449f1b80067e51e8bec00', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:39:27.121969 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affd0ebc-71f9-480c-a1d0-13c60561616d service glance] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:39:27.122252 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affd0ebc-71f9-480c-a1d0-13c60561616d service glance] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:39:27.122617 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affd0ebc-71f9-480c-a1d0-13c60561616d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:39:27.137096 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affd0ebc-71f9-480c-a1d0-13c60561616d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:39:27.139063 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affd0ebc-71f9-480c-a1d0-13c60561616d service glance] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:39:27.170098 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 600/1200] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 08:39:27 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 08:39:27.657717 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6ce677-40bc-4a07-a391-85d635f346e5 None None] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:39:27.658331 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6ce677-40bc-4a07-a391-85d635f346e5 None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:39:27.658574 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6ce677-40bc-4a07-a391-85d635f346e5 None None] PATH_INFO: `/` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:39:27.660874 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 601/1201] 10.222.0.62 () {54 vars in 912 bytes} [Fri May 27 08:39:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 27 08:39:27.667776 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8ee3b3-a7d8-4e0a-870a-dfac17fe5ff8 None None] REQUEST_METHOD: `POST` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:39:27.668152 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8ee3b3-a7d8-4e0a-870a-dfac17fe5ff8 None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:39:27.668506 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8ee3b3-a7d8-4e0a-870a-dfac17fe5ff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:39:27.702338 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.auth.core [None req-ee8ee3b3-a7d8-4e0a-870a-dfac17fe5ff8 None None] MFA Rules not processed for user `56934ba9afb741679e0573167d6825f5`. Rule list: `[]` (Enabled: `True`). {{(pid=87173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:39:27.705109 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.fernet_utils [None req-ee8ee3b3-a7d8-4e0a-870a-dfac17fe5ff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:39:27.737390 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=100 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:39:27.795905 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 601/1202] 10.222.0.62 () {58 vars in 1009 bytes} [Fri May 27 08:39:27 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 08:39:27.801357 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6ce677-40bc-4a07-a391-85d635f346e5 None None] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:39:27.822795 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6ce677-40bc-4a07-a391-85d635f346e5 None None] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:39:27.832966 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf58d15-cb4d-4b9d-b41b-e6475966ffcb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56934ba9afb741679e0573167d6825f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '256f4731060449f1b80067e51e8bec00', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:39:27.833638 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf58d15-cb4d-4b9d-b41b-e6475966ffcb service neutron] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:39:27.833921 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf58d15-cb4d-4b9d-b41b-e6475966ffcb service neutron] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:39:27.834198 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf58d15-cb4d-4b9d-b41b-e6475966ffcb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:39:27.854890 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf58d15-cb4d-4b9d-b41b-e6475966ffcb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:39:27.859213 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf58d15-cb4d-4b9d-b41b-e6475966ffcb service neutron] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:39:27.890461 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 602/1203] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 08:39:27 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 08:39:28.447502 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fcf083-e05e-4544-b973-e181638732eb None None] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:39:28.448071 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fcf083-e05e-4544-b973-e181638732eb None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:39:28.448071 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fcf083-e05e-4544-b973-e181638732eb None None] PATH_INFO: `/` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:39:28.449510 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 602/1204] 10.222.0.62 () {54 vars in 961 bytes} [Fri May 27 08:39:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:39:28.456889 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3197cea-6fb1-48a5-a30f-0d107a50e04a None None] REQUEST_METHOD: `POST` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:39:28.457707 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3197cea-6fb1-48a5-a30f-0d107a50e04a None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:39:28.458305 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3197cea-6fb1-48a5-a30f-0d107a50e04a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:39:28.470536 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b57fc7-008b-452e-b4ee-17280fc9c6c9 None None] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:39:28.470736 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b57fc7-008b-452e-b4ee-17280fc9c6c9 None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:39:28.471113 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b57fc7-008b-452e-b4ee-17280fc9c6c9 None None] PATH_INFO: `/` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:39:28.472828 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 603/1205] 10.222.0.62 () {54 vars in 960 bytes} [Fri May 27 08:39:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:39:28.480659 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf242ccb-1fe7-4cc3-9c5b-596235f967f6 None None] REQUEST_METHOD: `POST` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:39:28.480960 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf242ccb-1fe7-4cc3-9c5b-596235f967f6 None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:39:28.481250 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf242ccb-1fe7-4cc3-9c5b-596235f967f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:39:28.498442 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.auth.core [None req-d3197cea-6fb1-48a5-a30f-0d107a50e04a None None] MFA Rules not processed for user `3a09bdc2dbac4f9abe450ff121e7dce8`. Rule list: `[]` (Enabled: `True`). {{(pid=87172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:39:28.500548 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.fernet_utils [None req-d3197cea-6fb1-48a5-a30f-0d107a50e04a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:39:28.541838 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 603/1206] 10.222.0.62 () {58 vars in 1058 bytes} [Fri May 27 08:39:28 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 08:39:28.550181 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.auth.core [None req-bf242ccb-1fe7-4cc3-9c5b-596235f967f6 None None] MFA Rules not processed for user `7b12a598052a4b749edb0c021d99b951`. Rule list: `[]` (Enabled: `True`). {{(pid=87173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:39:28.551952 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.fernet_utils [None req-bf242ccb-1fe7-4cc3-9c5b-596235f967f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:39:28.552930 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7278e8-a802-4040-9344-b38d67f80199 None None] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:39:28.553459 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7278e8-a802-4040-9344-b38d67f80199 None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:39:28.554372 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7278e8-a802-4040-9344-b38d67f80199 None None] PATH_INFO: `/` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:39:28.560972 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 604/1207] 10.222.0.62 () {54 vars in 912 bytes} [Fri May 27 08:39:28 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:39:28.569372 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f45e57f-a761-4a98-906d-49259886adc1 None None] REQUEST_METHOD: `POST` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:39:28.569678 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f45e57f-a761-4a98-906d-49259886adc1 None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:39:28.569945 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f45e57f-a761-4a98-906d-49259886adc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:39:28.609116 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.auth.core [None req-7f45e57f-a761-4a98-906d-49259886adc1 None None] MFA Rules not processed for user `3a09bdc2dbac4f9abe450ff121e7dce8`. Rule list: `[]` (Enabled: `True`). {{(pid=87172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:39:28.611525 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.fernet_utils [None req-7f45e57f-a761-4a98-906d-49259886adc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:39:28.622938 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 605/1208] 10.222.0.62 () {58 vars in 1009 bytes} [Fri May 27 08:39:28 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 08:39:28.640301 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f45e57f-a761-4a98-906d-49259886adc1 None None] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:39:28.655175 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f45e57f-a761-4a98-906d-49259886adc1 None None] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:39:28.659707 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4171fb-3f68-4d27-97de-32e824ccaa54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56934ba9afb741679e0573167d6825f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '256f4731060449f1b80067e51e8bec00', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:39:28.660354 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4171fb-3f68-4d27-97de-32e824ccaa54 service neutron] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:39:28.660847 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4171fb-3f68-4d27-97de-32e824ccaa54 service neutron] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:39:28.660967 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4171fb-3f68-4d27-97de-32e824ccaa54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:39:28.674164 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4171fb-3f68-4d27-97de-32e824ccaa54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:39:28.675672 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4171fb-3f68-4d27-97de-32e824ccaa54 service neutron] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:39:28.683761 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 604/1209] 10.222.0.62 () {58 vars in 1057 bytes} [Fri May 27 08:39:28 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 08:39:28.693408 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 606/1210] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 08:39:28 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 08:39:28.697721 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf242ccb-1fe7-4cc3-9c5b-596235f967f6 None None] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:39:28.711905 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf242ccb-1fe7-4cc3-9c5b-596235f967f6 None None] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:39:28.720189 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3810abdc-0974-4e01-93cb-7a87eff9377c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b12a598052a4b749edb0c021d99b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '256f4731060449f1b80067e51e8bec00', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:39:28.720967 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3810abdc-0974-4e01-93cb-7a87eff9377c service placement] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:39:28.721240 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3810abdc-0974-4e01-93cb-7a87eff9377c service placement] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:39:28.721528 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3810abdc-0974-4e01-93cb-7a87eff9377c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:39:28.723682 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.fernet_utils [None req-3810abdc-0974-4e01-93cb-7a87eff9377c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:39:28.740062 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3810abdc-0974-4e01-93cb-7a87eff9377c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:39:28.741814 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3810abdc-0974-4e01-93cb-7a87eff9377c service placement] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:39:28.754453 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 605/1211] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 08:39:28 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 08:39:38.687989 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=23 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:39:38.750146 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=51 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:39:39.499914 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38930f9-3e41-419d-9f51-f8089b8e9f9a None None] REQUEST_METHOD: `POST` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:39:39.500441 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38930f9-3e41-419d-9f51-f8089b8e9f9a None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:39:39.500788 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38930f9-3e41-419d-9f51-f8089b8e9f9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:39:39.519120 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.auth.core [None req-d38930f9-3e41-419d-9f51-f8089b8e9f9a None None] MFA Rules not processed for user `56934ba9afb741679e0573167d6825f5`. Rule list: `[]` (Enabled: `True`). {{(pid=87172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:39:39.520334 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.fernet_utils [None req-d38930f9-3e41-419d-9f51-f8089b8e9f9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:39:39.527432 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 607/1212] 10.222.0.66 () {58 vars in 1015 bytes} [Fri May 27 08:39:39 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 08:39:39.540459 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3810abdc-0974-4e01-93cb-7a87eff9377c service placement] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:39:39.551943 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3810abdc-0974-4e01-93cb-7a87eff9377c service placement] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:39:39.556736 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237a37c3-eff9-47cd-a2ea-3aad48054995 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56934ba9afb741679e0573167d6825f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '256f4731060449f1b80067e51e8bec00', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:39:39.557430 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237a37c3-eff9-47cd-a2ea-3aad48054995 service neutron] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:39:39.557726 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237a37c3-eff9-47cd-a2ea-3aad48054995 service neutron] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:39:39.558035 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237a37c3-eff9-47cd-a2ea-3aad48054995 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:39:39.567457 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237a37c3-eff9-47cd-a2ea-3aad48054995 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:39:39.569548 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237a37c3-eff9-47cd-a2ea-3aad48054995 service neutron] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:39:39.581974 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 606/1213] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 08:39:39 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 08:39:40.478911 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85335a8-9320-4796-84d9-64473810d136 None None] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:39:40.479937 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85335a8-9320-4796-84d9-64473810d136 None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:39:40.480404 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85335a8-9320-4796-84d9-64473810d136 None None] PATH_INFO: `/` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:39:40.482104 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 608/1214] 10.222.0.62 () {54 vars in 921 bytes} [Fri May 27 08:39:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:39:40.517415 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dae67b6-7afc-44b8-a187-e473901e5bce None None] REQUEST_METHOD: `POST` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:39:40.518017 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dae67b6-7afc-44b8-a187-e473901e5bce None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:39:40.518129 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dae67b6-7afc-44b8-a187-e473901e5bce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:39:40.541722 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.auth.core [None req-5dae67b6-7afc-44b8-a187-e473901e5bce None None] MFA Rules not processed for user `3a09bdc2dbac4f9abe450ff121e7dce8`. Rule list: `[]` (Enabled: `True`). {{(pid=87173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:39:40.543416 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.fernet_utils [None req-5dae67b6-7afc-44b8-a187-e473901e5bce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:39:40.556390 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 607/1215] 10.222.0.62 () {58 vars in 1018 bytes} [Fri May 27 08:39:40 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 08:39:40.593345 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85335a8-9320-4796-84d9-64473810d136 None None] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:39:40.609424 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85335a8-9320-4796-84d9-64473810d136 None None] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:39:40.615270 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5703af88-f966-422f-97b6-31f791e43e77 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a09bdc2dbac4f9abe450ff121e7dce8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '256f4731060449f1b80067e51e8bec00', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:39:40.616147 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5703af88-f966-422f-97b6-31f791e43e77 service nova] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:39:40.616433 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5703af88-f966-422f-97b6-31f791e43e77 service nova] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:39:40.616748 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5703af88-f966-422f-97b6-31f791e43e77 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:39:40.626887 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5703af88-f966-422f-97b6-31f791e43e77 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:39:40.628657 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5703af88-f966-422f-97b6-31f791e43e77 service nova] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:39:40.642432 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 609/1216] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 08:39:40 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 08:39:45.965792 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd347ae-4d2c-46c8-8f6d-7fb725b2b704 None None] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:39:45.966360 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd347ae-4d2c-46c8-8f6d-7fb725b2b704 None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:39:45.966360 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd347ae-4d2c-46c8-8f6d-7fb725b2b704 None None] PATH_INFO: `/` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:39:45.967741 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 608/1217] 10.222.0.62 () {54 vars in 921 bytes} [Fri May 27 08:39:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:39:45.976927 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b92eecd-7402-4ca8-b37f-26e320e572ca None None] REQUEST_METHOD: `POST` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:39:45.977597 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b92eecd-7402-4ca8-b37f-26e320e572ca None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:39:45.977597 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b92eecd-7402-4ca8-b37f-26e320e572ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:39:45.999614 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.auth.core [None req-2b92eecd-7402-4ca8-b37f-26e320e572ca None None] MFA Rules not processed for user `3a09bdc2dbac4f9abe450ff121e7dce8`. Rule list: `[]` (Enabled: `True`). {{(pid=87172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:39:46.000903 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.fernet_utils [None req-2b92eecd-7402-4ca8-b37f-26e320e572ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:39:46.010780 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 610/1218] 10.222.0.62 () {58 vars in 1018 bytes} [Fri May 27 08:39:45 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 08:39:46.046274 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd347ae-4d2c-46c8-8f6d-7fb725b2b704 None None] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:39:46.063573 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd347ae-4d2c-46c8-8f6d-7fb725b2b704 None None] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:39:46.071847 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cee0250-fab5-4940-93d0-469824603eba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a09bdc2dbac4f9abe450ff121e7dce8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '256f4731060449f1b80067e51e8bec00', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:39:46.072507 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cee0250-fab5-4940-93d0-469824603eba service nova] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:39:46.073042 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cee0250-fab5-4940-93d0-469824603eba service nova] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:39:46.073323 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cee0250-fab5-4940-93d0-469824603eba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:39:46.086373 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cee0250-fab5-4940-93d0-469824603eba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:39:46.088330 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cee0250-fab5-4940-93d0-469824603eba service nova] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:39:46.102430 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 609/1219] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 08:39:46 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 08:39:55.873158 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b92eecd-7402-4ca8-b37f-26e320e572ca None None] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:39:55.884677 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b92eecd-7402-4ca8-b37f-26e320e572ca None None] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:39:55.888287 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf2cc0c-69d9-4b5d-9d7b-2ba25244bcd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56934ba9afb741679e0573167d6825f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '256f4731060449f1b80067e51e8bec00', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:39:55.888987 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf2cc0c-69d9-4b5d-9d7b-2ba25244bcd6 service neutron] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:39:55.889275 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf2cc0c-69d9-4b5d-9d7b-2ba25244bcd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:39:55.889555 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf2cc0c-69d9-4b5d-9d7b-2ba25244bcd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:39:55.900444 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf2cc0c-69d9-4b5d-9d7b-2ba25244bcd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:39:55.901933 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf2cc0c-69d9-4b5d-9d7b-2ba25244bcd6 service neutron] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:39:55.911898 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 611/1220] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 08:39:55 2022] GET /identity/v3/auth/tokens => generated 2879 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 08:39:56.095033 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=15 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:40:05.907490 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=18 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:40:19.805357 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3425d7-be10-456c-952b-0903dece78b9 None None] REQUEST_METHOD: `POST` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:40:19.805922 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3425d7-be10-456c-952b-0903dece78b9 None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:40:19.805922 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3425d7-be10-456c-952b-0903dece78b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:40:19.823434 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.auth.core [None req-bd3425d7-be10-456c-952b-0903dece78b9 None None] MFA Rules not processed for user `54110041d43d4a4c909c3404190f5f7f`. Rule list: `[]` (Enabled: `True`). {{(pid=87173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:40:19.824649 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.fernet_utils [None req-bd3425d7-be10-456c-952b-0903dece78b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:40:19.831674 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 610/1221] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 08:40:19 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 08:40:20.131120 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cacb483-55bb-4a89-a1d7-eaf51071a98a None None] REQUEST_METHOD: `POST` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:40:20.131665 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cacb483-55bb-4a89-a1d7-eaf51071a98a None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:40:20.131665 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cacb483-55bb-4a89-a1d7-eaf51071a98a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:40:20.150498 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.auth.core [None req-4cacb483-55bb-4a89-a1d7-eaf51071a98a None None] MFA Rules not processed for user `56934ba9afb741679e0573167d6825f5`. Rule list: `[]` (Enabled: `True`). {{(pid=87172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:40:20.151644 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.fernet_utils [None req-4cacb483-55bb-4a89-a1d7-eaf51071a98a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:40:20.159045 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 612/1222] 10.222.0.62 () {58 vars in 1009 bytes} [Fri May 27 08:40:20 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 08:40:20.170161 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3425d7-be10-456c-952b-0903dece78b9 None None] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:40:20.184523 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3425d7-be10-456c-952b-0903dece78b9 None None] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:40:20.188210 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c02d68-878b-44a4-91b2-4be1bae55b1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56934ba9afb741679e0573167d6825f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '256f4731060449f1b80067e51e8bec00', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:40:20.189121 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c02d68-878b-44a4-91b2-4be1bae55b1c service neutron] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:40:20.189419 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c02d68-878b-44a4-91b2-4be1bae55b1c service neutron] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:40:20.193171 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c02d68-878b-44a4-91b2-4be1bae55b1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:40:20.210670 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c02d68-878b-44a4-91b2-4be1bae55b1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:40:20.210670 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c02d68-878b-44a4-91b2-4be1bae55b1c service neutron] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:40:20.210670 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 611/1223] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 08:40:20 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 08:40:30.145045 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=3 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:40:30.204561 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=9 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:40:44.290503 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a94719-de3c-4fd7-86a8-0b2acd7a99e0 None None] REQUEST_METHOD: `POST` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:40:44.290983 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a94719-de3c-4fd7-86a8-0b2acd7a99e0 None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:40:44.291094 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a94719-de3c-4fd7-86a8-0b2acd7a99e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:40:44.308427 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.auth.core [None req-a9a94719-de3c-4fd7-86a8-0b2acd7a99e0 None None] MFA Rules not processed for user `54110041d43d4a4c909c3404190f5f7f`. Rule list: `[]` (Enabled: `True`). {{(pid=87172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:40:44.309675 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.fernet_utils [None req-a9a94719-de3c-4fd7-86a8-0b2acd7a99e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:40:44.316489 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 613/1224] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 08:40:44 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 08:40:54.303454 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=3 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:40:59.000362 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89001cb1-8ffc-4ef8-b183-c92d41b445d1 None None] REQUEST_METHOD: `POST` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:40:59.001141 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89001cb1-8ffc-4ef8-b183-c92d41b445d1 None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:40:59.001141 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89001cb1-8ffc-4ef8-b183-c92d41b445d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:40:59.020861 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.auth.core [None req-89001cb1-8ffc-4ef8-b183-c92d41b445d1 None None] MFA Rules not processed for user `54110041d43d4a4c909c3404190f5f7f`. Rule list: `[]` (Enabled: `True`). {{(pid=87173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:40:59.022436 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.fernet_utils [None req-89001cb1-8ffc-4ef8-b183-c92d41b445d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:40:59.029837 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 612/1225] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 08:40:58 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 08:41:09.015076 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=3 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:41:18.694454 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75056c2-c851-48bb-bd32-608c48363110 None None] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:41:18.695459 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75056c2-c851-48bb-bd32-608c48363110 None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:41:18.696036 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75056c2-c851-48bb-bd32-608c48363110 None None] PATH_INFO: `/` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:41:18.697661 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 614/1226] 10.222.0.62 () {54 vars in 921 bytes} [Fri May 27 08:41:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:41:18.704413 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf12c15f-116a-4b1d-a833-803c43b31e31 None None] REQUEST_METHOD: `POST` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:41:18.705007 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf12c15f-116a-4b1d-a833-803c43b31e31 None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:41:18.705007 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf12c15f-116a-4b1d-a833-803c43b31e31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:41:18.742564 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.auth.core [None req-cf12c15f-116a-4b1d-a833-803c43b31e31 None None] MFA Rules not processed for user `3a09bdc2dbac4f9abe450ff121e7dce8`. Rule list: `[]` (Enabled: `True`). {{(pid=87173) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:41:18.743814 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.fernet_utils [None req-cf12c15f-116a-4b1d-a833-803c43b31e31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:41:18.753830 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 613/1227] 10.222.0.62 () {58 vars in 1018 bytes} [Fri May 27 08:41:18 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 27 08:41:18.768281 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75056c2-c851-48bb-bd32-608c48363110 None None] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:41:18.790128 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75056c2-c851-48bb-bd32-608c48363110 None None] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:41:18.797431 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cd916f-d04d-4f68-95e8-37c306f8f78a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a09bdc2dbac4f9abe450ff121e7dce8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '256f4731060449f1b80067e51e8bec00', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:41:18.798244 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cd916f-d04d-4f68-95e8-37c306f8f78a service nova] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:41:18.799229 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cd916f-d04d-4f68-95e8-37c306f8f78a service nova] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:41:18.799753 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cd916f-d04d-4f68-95e8-37c306f8f78a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:41:18.810942 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cd916f-d04d-4f68-95e8-37c306f8f78a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:41:18.813375 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cd916f-d04d-4f68-95e8-37c306f8f78a service nova] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:41:18.828882 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 615/1228] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 08:41:18 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 08:41:28.357090 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1203c373-12ae-4396-9b8e-99218fec297b None None] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:41:28.357616 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1203c373-12ae-4396-9b8e-99218fec297b None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:41:28.357712 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1203c373-12ae-4396-9b8e-99218fec297b None None] PATH_INFO: `/` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:41:28.359059 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 614/1229] 10.222.0.62 () {54 vars in 921 bytes} [Fri May 27 08:41:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:41:28.369588 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15603ad-2eed-451e-92a5-b1cb2677ddd7 None None] REQUEST_METHOD: `POST` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:41:28.370080 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15603ad-2eed-451e-92a5-b1cb2677ddd7 None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:41:28.370565 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15603ad-2eed-451e-92a5-b1cb2677ddd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:41:28.393866 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.auth.core [None req-c15603ad-2eed-451e-92a5-b1cb2677ddd7 None None] MFA Rules not processed for user `7b12a598052a4b749edb0c021d99b951`. Rule list: `[]` (Enabled: `True`). {{(pid=87172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:41:28.395079 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.fernet_utils [None req-c15603ad-2eed-451e-92a5-b1cb2677ddd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:41:28.407169 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 616/1230] 10.222.0.62 () {58 vars in 1018 bytes} [Fri May 27 08:41:28 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 08:41:28.419640 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1203c373-12ae-4396-9b8e-99218fec297b None None] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:41:28.434131 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1203c373-12ae-4396-9b8e-99218fec297b None None] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:41:28.439914 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1fc370-6b2d-49e5-b958-eeae005d7f34 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b12a598052a4b749edb0c021d99b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '256f4731060449f1b80067e51e8bec00', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:41:28.440568 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1fc370-6b2d-49e5-b958-eeae005d7f34 service placement] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:41:28.441106 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1fc370-6b2d-49e5-b958-eeae005d7f34 service placement] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:41:28.441387 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1fc370-6b2d-49e5-b958-eeae005d7f34 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:41:28.450634 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1fc370-6b2d-49e5-b958-eeae005d7f34 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:41:28.452238 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1fc370-6b2d-49e5-b958-eeae005d7f34 service placement] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:41:28.464651 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 615/1231] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 08:41:28 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 08:41:31.903399 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15603ad-2eed-451e-92a5-b1cb2677ddd7 None None] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:41:32.002326 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15603ad-2eed-451e-92a5-b1cb2677ddd7 None None] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:41:32.008010 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a86a8f8-a4b2-4bf9-8382-7fe66ce06ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db9f476e682c4ed795ebf3f955e975c9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:41:32.009281 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a86a8f8-a4b2-4bf9-8382-7fe66ce06ebb admin admin] REQUEST_METHOD: `DELETE` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:41:32.009709 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a86a8f8-a4b2-4bf9-8382-7fe66ce06ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:41:32.010133 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a86a8f8-a4b2-4bf9-8382-7fe66ce06ebb admin admin] PATH_INFO: `/v3/users/6fe3eb41f0e445e59ad220eda1ac9b20` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:41:32.011660 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a86a8f8-a4b2-4bf9-8382-7fe66ce06ebb admin admin] RBAC: Authorizing `identity:delete_user(user_id=6fe3eb41f0e445e59ad220eda1ac9b20)` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:41:32.013844 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a86a8f8-a4b2-4bf9-8382-7fe66ce06ebb admin admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:41:32.088476 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.notifications [None req-5a86a8f8-a4b2-4bf9-8382-7fe66ce06ebb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6fe3eb41f0e445e59ad220eda1ac9b20'} {{(pid=87172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 08:41:32.097116 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.notifications [None req-5a86a8f8-a4b2-4bf9-8382-7fe66ce06ebb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6fe3eb41f0e445e59ad220eda1ac9b20'} {{(pid=87172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 08:41:32.097867 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.notifications [None req-5a86a8f8-a4b2-4bf9-8382-7fe66ce06ebb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6fe3eb41f0e445e59ad220eda1ac9b20'} {{(pid=87172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 08:41:32.106529 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.notifications [None req-5a86a8f8-a4b2-4bf9-8382-7fe66ce06ebb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6fe3eb41f0e445e59ad220eda1ac9b20'} {{(pid=87172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 08:41:32.107285 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.notifications [None req-5a86a8f8-a4b2-4bf9-8382-7fe66ce06ebb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6fe3eb41f0e445e59ad220eda1ac9b20'} {{(pid=87172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 08:41:32.128841 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 617/1232] 10.222.0.62 () {58 vars in 1223 bytes} [Fri May 27 08:41:31 2022] DELETE /identity/v3/users/6fe3eb41f0e445e59ad220eda1ac9b20 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 27 08:41:32.348842 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1fc370-6b2d-49e5-b958-eeae005d7f34 service placement] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:41:32.362105 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1fc370-6b2d-49e5-b958-eeae005d7f34 service placement] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:41:32.432497 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5849ac6e-a358-48ba-a334-c9beac98e650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db9f476e682c4ed795ebf3f955e975c9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:41:32.433540 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5849ac6e-a358-48ba-a334-c9beac98e650 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:41:32.433888 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5849ac6e-a358-48ba-a334-c9beac98e650 admin admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:41:32.434311 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5849ac6e-a358-48ba-a334-c9beac98e650 admin admin] PATH_INFO: `/v3/projects/34fbac72851c4325bac2829ba238a1bd` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:41:32.435562 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5849ac6e-a358-48ba-a334-c9beac98e650 admin admin] RBAC: Authorizing `identity:delete_project(project_id=34fbac72851c4325bac2829ba238a1bd)` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:41:32.438469 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5849ac6e-a358-48ba-a334-c9beac98e650 admin admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:41:32.492294 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.notifications [None req-5849ac6e-a358-48ba-a334-c9beac98e650 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34fbac72851c4325bac2829ba238a1bd', 'request_id': 'req-5849ac6e-a358-48ba-a334-c9beac98e650'} {{(pid=87173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 08:41:32.498731 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.notifications [None req-5849ac6e-a358-48ba-a334-c9beac98e650 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34fbac72851c4325bac2829ba238a1bd', 'request_id': 'req-5849ac6e-a358-48ba-a334-c9beac98e650'} {{(pid=87173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 08:41:32.507251 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.notifications [None req-5849ac6e-a358-48ba-a334-c9beac98e650 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34fbac72851c4325bac2829ba238a1bd', 'request_id': 'req-5849ac6e-a358-48ba-a334-c9beac98e650'} {{(pid=87173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 08:41:32.522173 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.notifications [None req-5849ac6e-a358-48ba-a334-c9beac98e650 admin admin] The token cache is being invalidate because project 34fbac72851c4325bac2829ba238a1bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87173) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 08:41:32.522473 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.notifications [None req-5849ac6e-a358-48ba-a334-c9beac98e650 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 08:41:32.523229 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.notifications [None req-5849ac6e-a358-48ba-a334-c9beac98e650 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 08:41:32.525161 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 616/1233] 10.222.0.62 () {58 vars in 1232 bytes} [Fri May 27 08:41:32 2022] DELETE /identity/v3/projects/34fbac72851c4325bac2829ba238a1bd => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 08:41:32.529505 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a86a8f8-a4b2-4bf9-8382-7fe66ce06ebb admin admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:41:32.531007 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.fernet_utils [None req-5a86a8f8-a4b2-4bf9-8382-7fe66ce06ebb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:41:32.545358 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a86a8f8-a4b2-4bf9-8382-7fe66ce06ebb admin admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:41:32.599542 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:41:32.611428 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5521747-728a-4de4-83f8-916368dcc727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db9f476e682c4ed795ebf3f955e975c9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:41:32.612396 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5521747-728a-4de4-83f8-916368dcc727 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:41:32.612692 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5521747-728a-4de4-83f8-916368dcc727 admin admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:41:32.612986 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5521747-728a-4de4-83f8-916368dcc727 admin admin] PATH_INFO: `/v3/users/b07a5cea4a2c41f3856c3143ccad5f16` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:41:32.614537 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5521747-728a-4de4-83f8-916368dcc727 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b07a5cea4a2c41f3856c3143ccad5f16)` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:41:32.617309 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5521747-728a-4de4-83f8-916368dcc727 admin admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:41:32.674149 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.notifications [None req-d5521747-728a-4de4-83f8-916368dcc727 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b07a5cea4a2c41f3856c3143ccad5f16'} {{(pid=87172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 08:41:32.681853 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.notifications [None req-d5521747-728a-4de4-83f8-916368dcc727 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b07a5cea4a2c41f3856c3143ccad5f16'} {{(pid=87172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 08:41:32.682571 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.notifications [None req-d5521747-728a-4de4-83f8-916368dcc727 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b07a5cea4a2c41f3856c3143ccad5f16'} {{(pid=87172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 08:41:32.692266 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.notifications [None req-d5521747-728a-4de4-83f8-916368dcc727 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b07a5cea4a2c41f3856c3143ccad5f16'} {{(pid=87172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 08:41:32.693462 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.notifications [None req-d5521747-728a-4de4-83f8-916368dcc727 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b07a5cea4a2c41f3856c3143ccad5f16'} {{(pid=87172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 08:41:32.716355 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 618/1234] 10.222.0.62 () {58 vars in 1223 bytes} [Fri May 27 08:41:32 2022] DELETE /identity/v3/users/b07a5cea4a2c41f3856c3143ccad5f16 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 08:41:33.146833 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5849ac6e-a358-48ba-a334-c9beac98e650 admin admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:41:33.148556 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.fernet_utils [None req-5849ac6e-a358-48ba-a334-c9beac98e650 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:41:33.164003 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5849ac6e-a358-48ba-a334-c9beac98e650 admin admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:41:33.235623 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58755f78-2479-4ee7-afdf-45dfa6a4892f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db9f476e682c4ed795ebf3f955e975c9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:41:33.236496 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58755f78-2479-4ee7-afdf-45dfa6a4892f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:41:33.236813 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58755f78-2479-4ee7-afdf-45dfa6a4892f admin admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:41:33.237091 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58755f78-2479-4ee7-afdf-45dfa6a4892f admin admin] PATH_INFO: `/v3/projects/535097420f19472dac36431bfa3b0c64` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:41:33.238305 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58755f78-2479-4ee7-afdf-45dfa6a4892f admin admin] RBAC: Authorizing `identity:delete_project(project_id=535097420f19472dac36431bfa3b0c64)` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:41:33.245301 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58755f78-2479-4ee7-afdf-45dfa6a4892f admin admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:41:33.248779 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:41:33.298238 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.notifications [None req-58755f78-2479-4ee7-afdf-45dfa6a4892f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '535097420f19472dac36431bfa3b0c64', 'request_id': 'req-58755f78-2479-4ee7-afdf-45dfa6a4892f'} {{(pid=87173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 08:41:33.304575 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.notifications [None req-58755f78-2479-4ee7-afdf-45dfa6a4892f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '535097420f19472dac36431bfa3b0c64', 'request_id': 'req-58755f78-2479-4ee7-afdf-45dfa6a4892f'} {{(pid=87173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 08:41:33.310833 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.notifications [None req-58755f78-2479-4ee7-afdf-45dfa6a4892f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '535097420f19472dac36431bfa3b0c64', 'request_id': 'req-58755f78-2479-4ee7-afdf-45dfa6a4892f'} {{(pid=87173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 08:41:33.324273 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.notifications [None req-58755f78-2479-4ee7-afdf-45dfa6a4892f admin admin] The token cache is being invalidate because project 535097420f19472dac36431bfa3b0c64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87173) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 08:41:33.324608 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.notifications [None req-58755f78-2479-4ee7-afdf-45dfa6a4892f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 08:41:33.325417 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.notifications [None req-58755f78-2479-4ee7-afdf-45dfa6a4892f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 08:41:33.327390 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 617/1235] 10.222.0.62 () {58 vars in 1232 bytes} [Fri May 27 08:41:33 2022] DELETE /identity/v3/projects/535097420f19472dac36431bfa3b0c64 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 08:41:42.711489 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=30,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:41:43.320995 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=23,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:42:00.185573 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45757b51-a1bf-423b-b632-404c95abe898 None None] REQUEST_METHOD: `POST` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:42:00.186138 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45757b51-a1bf-423b-b632-404c95abe898 None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:42:00.186138 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45757b51-a1bf-423b-b632-404c95abe898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:42:00.204466 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.auth.core [None req-45757b51-a1bf-423b-b632-404c95abe898 None None] MFA Rules not processed for user `54110041d43d4a4c909c3404190f5f7f`. Rule list: `[]` (Enabled: `True`). {{(pid=87172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:42:00.205723 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.fernet_utils [None req-45757b51-a1bf-423b-b632-404c95abe898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:42:00.263033 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 619/1236] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 08:42:00 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 08:42:10.255633 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=25 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:42:12.980460 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58755f78-2479-4ee7-afdf-45dfa6a4892f admin admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:42:12.981935 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.fernet_utils [None req-58755f78-2479-4ee7-afdf-45dfa6a4892f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:42:13.054983 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58755f78-2479-4ee7-afdf-45dfa6a4892f admin admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:42:13.059833 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfe96f4-7433-455a-bc94-2642cbef4712 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56934ba9afb741679e0573167d6825f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '256f4731060449f1b80067e51e8bec00', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:42:13.060557 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfe96f4-7433-455a-bc94-2642cbef4712 service neutron] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:42:13.060874 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfe96f4-7433-455a-bc94-2642cbef4712 service neutron] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:42:13.061148 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfe96f4-7433-455a-bc94-2642cbef4712 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:42:13.063219 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.fernet_utils [None req-2bfe96f4-7433-455a-bc94-2642cbef4712 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:42:13.135691 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfe96f4-7433-455a-bc94-2642cbef4712 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:42:13.137277 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfe96f4-7433-455a-bc94-2642cbef4712 service neutron] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:42:13.149297 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 618/1237] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 08:42:12 2022] GET /identity/v3/auth/tokens => generated 2871 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 08:42:23.143857 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=54 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:43:22.039250 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45757b51-a1bf-423b-b632-404c95abe898 None None] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:43:22.040677 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.fernet_utils [None req-45757b51-a1bf-423b-b632-404c95abe898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:43:22.121626 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45757b51-a1bf-423b-b632-404c95abe898 None None] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:43:22.126573 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdc126b-f322-4f1a-b7a4-1f235488bfd9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b12a598052a4b749edb0c021d99b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '256f4731060449f1b80067e51e8bec00', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:43:22.127225 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc126b-f322-4f1a-b7a4-1f235488bfd9 service placement] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:43:22.127512 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc126b-f322-4f1a-b7a4-1f235488bfd9 service placement] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:43:22.127791 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc126b-f322-4f1a-b7a4-1f235488bfd9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:43:22.129789 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.fernet_utils [None req-fbdc126b-f322-4f1a-b7a4-1f235488bfd9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:43:22.142248 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdc126b-f322-4f1a-b7a4-1f235488bfd9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:43:22.143839 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdc126b-f322-4f1a-b7a4-1f235488bfd9 service placement] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:43:22.154966 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 620/1238] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 08:43:22 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 08:43:32.150471 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=36 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:44:20.101306 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfe96f4-7433-455a-bc94-2642cbef4712 service neutron] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:44:20.103668 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.fernet_utils [None req-2bfe96f4-7433-455a-bc94-2642cbef4712 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:44:20.183139 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfe96f4-7433-455a-bc94-2642cbef4712 service neutron] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:44:20.188992 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b10cc99-d8a9-4638-b61f-f92bd45a9fd4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a09bdc2dbac4f9abe450ff121e7dce8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '256f4731060449f1b80067e51e8bec00', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:44:20.189641 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b10cc99-d8a9-4638-b61f-f92bd45a9fd4 service nova] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:44:20.189924 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b10cc99-d8a9-4638-b61f-f92bd45a9fd4 service nova] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:44:20.190199 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b10cc99-d8a9-4638-b61f-f92bd45a9fd4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:44:20.191994 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.fernet_utils [None req-6b10cc99-d8a9-4638-b61f-f92bd45a9fd4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:44:20.203394 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b10cc99-d8a9-4638-b61f-f92bd45a9fd4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:44:20.205102 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b10cc99-d8a9-4638-b61f-f92bd45a9fd4 service nova] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:44:20.214246 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 619/1239] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 08:44:20 2022] GET /identity/v3/auth/tokens => generated 2806 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 08:44:23.968639 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89875b26-5e3e-4f88-a801-2ef37c7a5cc2 None None] REQUEST_METHOD: `POST` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:44:23.969158 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89875b26-5e3e-4f88-a801-2ef37c7a5cc2 None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:44:23.969260 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89875b26-5e3e-4f88-a801-2ef37c7a5cc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:44:23.988340 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.auth.core [None req-89875b26-5e3e-4f88-a801-2ef37c7a5cc2 None None] MFA Rules not processed for user `54110041d43d4a4c909c3404190f5f7f`. Rule list: `[]` (Enabled: `True`). {{(pid=87172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:44:23.989609 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.fernet_utils [None req-89875b26-5e3e-4f88-a801-2ef37c7a5cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:44:23.997456 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 621/1240] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 08:44:23 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 08:44:29.346673 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b10cc99-d8a9-4638-b61f-f92bd45a9fd4 service nova] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:44:29.348074 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.fernet_utils [None req-6b10cc99-d8a9-4638-b61f-f92bd45a9fd4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:44:29.359960 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b10cc99-d8a9-4638-b61f-f92bd45a9fd4 service nova] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:44:29.363614 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b660c47f-6f05-43f5-8a98-c99e73bea8aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56934ba9afb741679e0573167d6825f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '256f4731060449f1b80067e51e8bec00', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:44:29.364249 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b660c47f-6f05-43f5-8a98-c99e73bea8aa service neutron] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:44:29.364538 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b660c47f-6f05-43f5-8a98-c99e73bea8aa service neutron] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:44:29.364866 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b660c47f-6f05-43f5-8a98-c99e73bea8aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:44:29.366611 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.fernet_utils [None req-b660c47f-6f05-43f5-8a98-c99e73bea8aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:44:29.379500 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b660c47f-6f05-43f5-8a98-c99e73bea8aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:44:29.380913 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b660c47f-6f05-43f5-8a98-c99e73bea8aa service neutron] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:44:29.391776 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 620/1241] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 08:44:29 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 08:44:30.571038 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89875b26-5e3e-4f88-a801-2ef37c7a5cc2 None None] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:44:30.581269 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89875b26-5e3e-4f88-a801-2ef37c7a5cc2 None None] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:44:30.585179 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4f06f2-64fa-4b9a-ba20-884c6a5cfeed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56934ba9afb741679e0573167d6825f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '256f4731060449f1b80067e51e8bec00', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:44:30.585521 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4f06f2-64fa-4b9a-ba20-884c6a5cfeed service neutron] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:44:30.585804 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4f06f2-64fa-4b9a-ba20-884c6a5cfeed service neutron] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:44:30.586104 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4f06f2-64fa-4b9a-ba20-884c6a5cfeed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:44:30.588576 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.fernet_utils [None req-8a4f06f2-64fa-4b9a-ba20-884c6a5cfeed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:44:30.601304 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4f06f2-64fa-4b9a-ba20-884c6a5cfeed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:44:30.602866 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4f06f2-64fa-4b9a-ba20-884c6a5cfeed service neutron] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:44:30.612994 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 622/1242] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 08:44:30 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 08:44:39.387245 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=42 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:44:40.608539 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=9 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:45:27.747436 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b660c47f-6f05-43f5-8a98-c99e73bea8aa service neutron] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:45:27.756058 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b660c47f-6f05-43f5-8a98-c99e73bea8aa service neutron] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:45:27.759962 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1ee236-2dd4-47b6-b413-a78b22d3ae09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56934ba9afb741679e0573167d6825f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '256f4731060449f1b80067e51e8bec00', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:45:27.760672 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1ee236-2dd4-47b6-b413-a78b22d3ae09 service neutron] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:45:27.760927 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1ee236-2dd4-47b6-b413-a78b22d3ae09 service neutron] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:45:27.761210 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1ee236-2dd4-47b6-b413-a78b22d3ae09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:45:27.763028 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.fernet_utils [None req-4a1ee236-2dd4-47b6-b413-a78b22d3ae09 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:45:27.773397 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1ee236-2dd4-47b6-b413-a78b22d3ae09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:45:27.775003 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1ee236-2dd4-47b6-b413-a78b22d3ae09 service neutron] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:45:27.783631 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 621/1243] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 08:45:27 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 08:45:37.779907 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=6 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:46:15.696111 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e0bf7c-230d-4500-b18d-0ec95f7e55d6 None None] REQUEST_METHOD: `POST` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:46:15.696700 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e0bf7c-230d-4500-b18d-0ec95f7e55d6 None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:46:15.696793 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e0bf7c-230d-4500-b18d-0ec95f7e55d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:46:15.723651 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.auth.core [None req-05e0bf7c-230d-4500-b18d-0ec95f7e55d6 None None] MFA Rules not processed for user `54110041d43d4a4c909c3404190f5f7f`. Rule list: `[]` (Enabled: `True`). {{(pid=87172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:46:15.724887 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.fernet_utils [None req-05e0bf7c-230d-4500-b18d-0ec95f7e55d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:46:15.745173 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 623/1244] 10.222.0.62 () {58 vars in 957 bytes} [Fri May 27 08:46:15 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 08:46:16.065351 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1ee236-2dd4-47b6-b413-a78b22d3ae09 service neutron] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:46:16.074634 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1ee236-2dd4-47b6-b413-a78b22d3ae09 service neutron] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:46:16.078268 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbaa051-9e7d-4c2d-ac88-10304313103f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56934ba9afb741679e0573167d6825f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '256f4731060449f1b80067e51e8bec00', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:46:16.078909 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbaa051-9e7d-4c2d-ac88-10304313103f service neutron] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:46:16.079195 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbaa051-9e7d-4c2d-ac88-10304313103f service neutron] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:46:16.079476 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbaa051-9e7d-4c2d-ac88-10304313103f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:46:16.081390 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.fernet_utils [None req-bcbaa051-9e7d-4c2d-ac88-10304313103f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:46:16.091673 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbaa051-9e7d-4c2d-ac88-10304313103f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:46:16.093128 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbaa051-9e7d-4c2d-ac88-10304313103f service neutron] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:46:16.101015 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 622/1245] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 08:46:16 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 08:46:16.546894 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e0bf7c-230d-4500-b18d-0ec95f7e55d6 None None] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:46:16.567868 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e0bf7c-230d-4500-b18d-0ec95f7e55d6 None None] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:46:16.573496 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563254cb-e1cf-4e14-aac4-4066c6d7e08d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b12a598052a4b749edb0c021d99b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '256f4731060449f1b80067e51e8bec00', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:46:16.574255 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563254cb-e1cf-4e14-aac4-4066c6d7e08d service placement] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:46:16.574624 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563254cb-e1cf-4e14-aac4-4066c6d7e08d service placement] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:46:16.574975 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563254cb-e1cf-4e14-aac4-4066c6d7e08d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:46:16.577071 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.fernet_utils [None req-563254cb-e1cf-4e14-aac4-4066c6d7e08d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:46:16.590074 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563254cb-e1cf-4e14-aac4-4066c6d7e08d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:46:16.592491 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563254cb-e1cf-4e14-aac4-4066c6d7e08d service placement] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:46:16.608289 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 624/1246] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 08:46:16 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 08:46:19.344459 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbaa051-9e7d-4c2d-ac88-10304313103f service neutron] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:46:19.350386 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.fernet_utils [None req-bcbaa051-9e7d-4c2d-ac88-10304313103f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:46:19.376483 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbaa051-9e7d-4c2d-ac88-10304313103f service neutron] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:46:19.382859 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0a0930-4f55-4cbe-b5aa-7d669283eecf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a09bdc2dbac4f9abe450ff121e7dce8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '256f4731060449f1b80067e51e8bec00', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:46:19.383854 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0a0930-4f55-4cbe-b5aa-7d669283eecf service nova] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:46:19.384145 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0a0930-4f55-4cbe-b5aa-7d669283eecf service nova] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:46:19.384430 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0a0930-4f55-4cbe-b5aa-7d669283eecf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:46:19.387302 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.fernet_utils [None req-2e0a0930-4f55-4cbe-b5aa-7d669283eecf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:46:19.404355 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0a0930-4f55-4cbe-b5aa-7d669283eecf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:46:19.407163 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0a0930-4f55-4cbe-b5aa-7d669283eecf service nova] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:46:19.430590 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 623/1247] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 08:46:19 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 08:46:26.100059 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563254cb-e1cf-4e14-aac4-4066c6d7e08d service placement] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:46:26.122167 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563254cb-e1cf-4e14-aac4-4066c6d7e08d service placement] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:46:26.127945 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f329c4f-f118-409c-9f0f-c826668b8159 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a09bdc2dbac4f9abe450ff121e7dce8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '256f4731060449f1b80067e51e8bec00', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:46:26.128633 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f329c4f-f118-409c-9f0f-c826668b8159 service nova] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:46:26.128919 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f329c4f-f118-409c-9f0f-c826668b8159 service nova] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:46:26.129192 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f329c4f-f118-409c-9f0f-c826668b8159 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:46:26.131160 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.fernet_utils [None req-9f329c4f-f118-409c-9f0f-c826668b8159 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:46:26.145821 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f329c4f-f118-409c-9f0f-c826668b8159 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:46:26.147527 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f329c4f-f118-409c-9f0f-c826668b8159 service nova] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:46:26.163158 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 625/1248] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 08:46:26 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 08:46:29.415709 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=12 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:46:30.425625 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0a0930-4f55-4cbe-b5aa-7d669283eecf service nova] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:46:30.437005 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0a0930-4f55-4cbe-b5aa-7d669283eecf service nova] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:46:30.443628 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2fb9bc-269c-4c46-891c-2e8f3181ea4d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a09bdc2dbac4f9abe450ff121e7dce8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '256f4731060449f1b80067e51e8bec00', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:46:30.444424 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2fb9bc-269c-4c46-891c-2e8f3181ea4d service nova] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:46:30.444820 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2fb9bc-269c-4c46-891c-2e8f3181ea4d service nova] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:46:30.445237 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2fb9bc-269c-4c46-891c-2e8f3181ea4d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:46:30.447344 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.fernet_utils [None req-7d2fb9bc-269c-4c46-891c-2e8f3181ea4d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:46:30.461229 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2fb9bc-269c-4c46-891c-2e8f3181ea4d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:46:30.462858 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2fb9bc-269c-4c46-891c-2e8f3181ea4d service nova] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:46:30.474652 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 624/1249] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 08:46:30 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 08:46:36.154156 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=28 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:46:40.470093 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=6 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:48:22.739173 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f329c4f-f118-409c-9f0f-c826668b8159 service nova] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:48:22.767718 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f329c4f-f118-409c-9f0f-c826668b8159 service nova] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:48:22.772849 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc4d52b-dedd-403a-b8d3-f9955a515179 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b12a598052a4b749edb0c021d99b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '256f4731060449f1b80067e51e8bec00', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:48:22.773497 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc4d52b-dedd-403a-b8d3-f9955a515179 service placement] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:48:22.773788 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc4d52b-dedd-403a-b8d3-f9955a515179 service placement] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:48:22.774093 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc4d52b-dedd-403a-b8d3-f9955a515179 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:48:22.784485 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc4d52b-dedd-403a-b8d3-f9955a515179 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:48:22.786174 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc4d52b-dedd-403a-b8d3-f9955a515179 service placement] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:48:22.797251 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 626/1250] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 08:48:22 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 08:48:32.792675 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=11 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:49:02.094853 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2fb9bc-269c-4c46-891c-2e8f3181ea4d service nova] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:49:02.116681 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2fb9bc-269c-4c46-891c-2e8f3181ea4d service nova] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:49:02.120960 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43a93c3-02c4-47a1-939d-e681124df51b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '56934ba9afb741679e0573167d6825f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '256f4731060449f1b80067e51e8bec00', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:49:02.121970 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43a93c3-02c4-47a1-939d-e681124df51b service neutron] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:49:02.122261 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43a93c3-02c4-47a1-939d-e681124df51b service neutron] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:49:02.122664 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43a93c3-02c4-47a1-939d-e681124df51b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:49:02.124542 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.fernet_utils [None req-f43a93c3-02c4-47a1-939d-e681124df51b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:49:02.216107 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43a93c3-02c4-47a1-939d-e681124df51b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:49:02.217523 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43a93c3-02c4-47a1-939d-e681124df51b service neutron] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:49:02.228734 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 625/1251] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 08:49:02 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 08:49:05.261606 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc4d52b-dedd-403a-b8d3-f9955a515179 service placement] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:49:05.263410 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.fernet_utils [None req-4dc4d52b-dedd-403a-b8d3-f9955a515179 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:49:05.305099 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc4d52b-dedd-403a-b8d3-f9955a515179 service placement] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:49:05.322672 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c69f0d6-8d9b-420e-9c1c-1112fe002254 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b12a598052a4b749edb0c021d99b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '256f4731060449f1b80067e51e8bec00', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:49:05.323680 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c69f0d6-8d9b-420e-9c1c-1112fe002254 service placement] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:49:05.324153 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c69f0d6-8d9b-420e-9c1c-1112fe002254 service placement] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:49:05.324631 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c69f0d6-8d9b-420e-9c1c-1112fe002254 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:49:05.328007 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.fernet_utils [None req-2c69f0d6-8d9b-420e-9c1c-1112fe002254 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:49:05.342998 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c69f0d6-8d9b-420e-9c1c-1112fe002254 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:49:05.345104 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c69f0d6-8d9b-420e-9c1c-1112fe002254 service placement] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:49:05.358535 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 627/1252] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 08:49:05 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 27 08:49:08.510609 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743bdcd7-88f9-441b-98c2-1ea2c7ec35ee None None] REQUEST_METHOD: `GET` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:49:08.511177 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743bdcd7-88f9-441b-98c2-1ea2c7ec35ee None None] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:49:08.511177 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743bdcd7-88f9-441b-98c2-1ea2c7ec35ee None None] PATH_INFO: `/` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:49:08.512611 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 626/1253] 10.222.0.62 () {54 vars in 921 bytes} [Fri May 27 08:49:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 27 08:49:08.527128 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc855e89-ef39-4db5-8a0e-ca0c674213da None None] REQUEST_METHOD: `POST` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:49:08.528034 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc855e89-ef39-4db5-8a0e-ca0c674213da None None] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:49:08.528367 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc855e89-ef39-4db5-8a0e-ca0c674213da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:49:08.579186 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.auth.core [None req-cc855e89-ef39-4db5-8a0e-ca0c674213da None None] MFA Rules not processed for user `7b12a598052a4b749edb0c021d99b951`. Rule list: `[]` (Enabled: `True`). {{(pid=87172) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 27 08:49:08.580514 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.fernet_utils [None req-cc855e89-ef39-4db5-8a0e-ca0c674213da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:49:08.591158 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 628/1254] 10.222.0.62 () {58 vars in 1018 bytes} [Fri May 27 08:49:08 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 27 08:49:08.594688 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743bdcd7-88f9-441b-98c2-1ea2c7ec35ee None None] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:49:08.596846 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.fernet_utils [None req-743bdcd7-88f9-441b-98c2-1ea2c7ec35ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:49:08.612017 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc855e89-ef39-4db5-8a0e-ca0c674213da None None] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:49:08.625420 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743bdcd7-88f9-441b-98c2-1ea2c7ec35ee None None] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:49:08.629010 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc855e89-ef39-4db5-8a0e-ca0c674213da None None] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:49:08.633221 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d132e4cf-bbfc-4f90-92a1-8b14bb07a69a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db9f476e682c4ed795ebf3f955e975c9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:49:08.634958 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d132e4cf-bbfc-4f90-92a1-8b14bb07a69a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:49:08.635246 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d132e4cf-bbfc-4f90-92a1-8b14bb07a69a admin admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:49:08.635414 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0289f3f7-1d00-4cb1-b2e9-d088487a892a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b12a598052a4b749edb0c021d99b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '256f4731060449f1b80067e51e8bec00', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:49:08.635574 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d132e4cf-bbfc-4f90-92a1-8b14bb07a69a admin admin] PATH_INFO: `/v3/users/54110041d43d4a4c909c3404190f5f7f` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:49:08.636397 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0289f3f7-1d00-4cb1-b2e9-d088487a892a service placement] REQUEST_METHOD: `GET` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:49:08.636723 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0289f3f7-1d00-4cb1-b2e9-d088487a892a service placement] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:49:08.638415 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0289f3f7-1d00-4cb1-b2e9-d088487a892a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:49:08.651858 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0289f3f7-1d00-4cb1-b2e9-d088487a892a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:49:08.653524 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0289f3f7-1d00-4cb1-b2e9-d088487a892a service placement] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:49:08.666766 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d132e4cf-bbfc-4f90-92a1-8b14bb07a69a admin admin] RBAC: Authorizing `identity:delete_user(user_id=54110041d43d4a4c909c3404190f5f7f)` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:49:08.667673 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 629/1255] 10.222.0.62 () {60 vars in 1365 bytes} [Fri May 27 08:49:08 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 27 08:49:08.668231 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: WARNING py.warnings [None req-d132e4cf-bbfc-4f90-92a1-8b14bb07a69a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 27 08:49:08.668231 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: warnings.warn(msg) May 27 08:49:08.668231 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: May 27 08:49:08.669622 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d132e4cf-bbfc-4f90-92a1-8b14bb07a69a admin admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:49:08.747156 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.notifications [None req-d132e4cf-bbfc-4f90-92a1-8b14bb07a69a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54110041d43d4a4c909c3404190f5f7f'} {{(pid=87173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 08:49:08.758305 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.notifications [None req-d132e4cf-bbfc-4f90-92a1-8b14bb07a69a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54110041d43d4a4c909c3404190f5f7f'} {{(pid=87173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 08:49:08.759024 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.notifications [None req-d132e4cf-bbfc-4f90-92a1-8b14bb07a69a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54110041d43d4a4c909c3404190f5f7f'} {{(pid=87173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 08:49:08.766349 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.notifications [None req-d132e4cf-bbfc-4f90-92a1-8b14bb07a69a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54110041d43d4a4c909c3404190f5f7f'} {{(pid=87173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 08:49:08.767127 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.notifications [None req-d132e4cf-bbfc-4f90-92a1-8b14bb07a69a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54110041d43d4a4c909c3404190f5f7f'} {{(pid=87173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 08:49:08.793364 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 627/1256] 10.222.0.62 () {58 vars in 1223 bytes} [Fri May 27 08:49:08 2022] DELETE /identity/v3/users/54110041d43d4a4c909c3404190f5f7f => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 08:49:08.968524 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0289f3f7-1d00-4cb1-b2e9-d088487a892a service placement] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:49:08.984482 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0289f3f7-1d00-4cb1-b2e9-d088487a892a service placement] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:49:09.056450 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad72aec-b045-43ae-8af5-3d23cf9961bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db9f476e682c4ed795ebf3f955e975c9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:49:09.057341 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad72aec-b045-43ae-8af5-3d23cf9961bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:49:09.057628 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad72aec-b045-43ae-8af5-3d23cf9961bd admin admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:49:09.057905 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad72aec-b045-43ae-8af5-3d23cf9961bd admin admin] PATH_INFO: `/v3/projects/35985dbf06f84514b54e2f86e9a25802` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:49:09.070275 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad72aec-b045-43ae-8af5-3d23cf9961bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=35985dbf06f84514b54e2f86e9a25802)` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:49:09.071322 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: WARNING py.warnings [None req-7ad72aec-b045-43ae-8af5-3d23cf9961bd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 27 08:49:09.071322 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: warnings.warn(msg) May 27 08:49:09.071322 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: May 27 08:49:09.072509 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad72aec-b045-43ae-8af5-3d23cf9961bd admin admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:49:09.126573 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.notifications [None req-7ad72aec-b045-43ae-8af5-3d23cf9961bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35985dbf06f84514b54e2f86e9a25802', 'request_id': 'req-7ad72aec-b045-43ae-8af5-3d23cf9961bd'} {{(pid=87172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 08:49:09.133464 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.notifications [None req-7ad72aec-b045-43ae-8af5-3d23cf9961bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35985dbf06f84514b54e2f86e9a25802', 'request_id': 'req-7ad72aec-b045-43ae-8af5-3d23cf9961bd'} {{(pid=87172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 08:49:09.141064 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.notifications [None req-7ad72aec-b045-43ae-8af5-3d23cf9961bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35985dbf06f84514b54e2f86e9a25802', 'request_id': 'req-7ad72aec-b045-43ae-8af5-3d23cf9961bd'} {{(pid=87172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 08:49:09.162991 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.notifications [None req-7ad72aec-b045-43ae-8af5-3d23cf9961bd admin admin] The token cache is being invalidate because project 35985dbf06f84514b54e2f86e9a25802 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87172) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 08:49:09.163284 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.notifications [None req-7ad72aec-b045-43ae-8af5-3d23cf9961bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 08:49:09.163965 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.notifications [None req-7ad72aec-b045-43ae-8af5-3d23cf9961bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 08:49:09.165571 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 630/1257] 10.222.0.62 () {58 vars in 1232 bytes} [Fri May 27 08:49:08 2022] DELETE /identity/v3/projects/35985dbf06f84514b54e2f86e9a25802 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 08:49:09.169572 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d132e4cf-bbfc-4f90-92a1-8b14bb07a69a admin admin] Authenticating user token {{(pid=87173) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:49:09.171012 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.fernet_utils [None req-d132e4cf-bbfc-4f90-92a1-8b14bb07a69a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87173) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:49:09.184880 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d132e4cf-bbfc-4f90-92a1-8b14bb07a69a admin admin] Validating token access rules against request {{(pid=87173) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:49:09.206023 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:49:09.244883 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b981d3-eb4f-407c-8f39-c7b659c1fff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db9f476e682c4ed795ebf3f955e975c9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87173) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:49:09.245675 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b981d3-eb4f-407c-8f39-c7b659c1fff2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:49:09.245966 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b981d3-eb4f-407c-8f39-c7b659c1fff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:49:09.246245 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b981d3-eb4f-407c-8f39-c7b659c1fff2 admin admin] PATH_INFO: `/v3/users/d244e3d27f3641c7b6f35710568bb69d` {{(pid=87173) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:49:09.247460 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b981d3-eb4f-407c-8f39-c7b659c1fff2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d244e3d27f3641c7b6f35710568bb69d)` {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:49:09.249458 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b981d3-eb4f-407c-8f39-c7b659c1fff2 admin admin] RBAC: Authorization granted {{(pid=87173) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:49:09.297159 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.notifications [None req-c1b981d3-eb4f-407c-8f39-c7b659c1fff2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd244e3d27f3641c7b6f35710568bb69d'} {{(pid=87173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 08:49:09.304937 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.notifications [None req-c1b981d3-eb4f-407c-8f39-c7b659c1fff2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd244e3d27f3641c7b6f35710568bb69d'} {{(pid=87173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 08:49:09.305676 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.notifications [None req-c1b981d3-eb4f-407c-8f39-c7b659c1fff2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd244e3d27f3641c7b6f35710568bb69d'} {{(pid=87173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 08:49:09.313698 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.notifications [None req-c1b981d3-eb4f-407c-8f39-c7b659c1fff2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd244e3d27f3641c7b6f35710568bb69d'} {{(pid=87173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 08:49:09.314379 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG keystone.notifications [None req-c1b981d3-eb4f-407c-8f39-c7b659c1fff2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd244e3d27f3641c7b6f35710568bb69d'} {{(pid=87173) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 08:49:09.332504 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: [pid: 87173|app: 0|req: 628/1258] 10.222.0.62 () {58 vars in 1223 bytes} [Fri May 27 08:49:09 2022] DELETE /identity/v3/users/d244e3d27f3641c7b6f35710568bb69d => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 08:49:09.504197 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad72aec-b045-43ae-8af5-3d23cf9961bd admin admin] Authenticating user token {{(pid=87172) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 27 08:49:09.505771 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.fernet_utils [None req-7ad72aec-b045-43ae-8af5-3d23cf9961bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87172) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 27 08:49:09.520255 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad72aec-b045-43ae-8af5-3d23cf9961bd admin admin] Validating token access rules against request {{(pid=87172) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 27 08:49:09.532885 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:49:09.580268 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0356233b-3320-419f-97b8-f24899175020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ca179b0a3ab4467ba61f4e713c6eb763', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'db9f476e682c4ed795ebf3f955e975c9', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87172) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 27 08:49:09.581258 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0356233b-3320-419f-97b8-f24899175020 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 27 08:49:09.581517 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0356233b-3320-419f-97b8-f24899175020 admin admin] SCRIPT_NAME: `/identity` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 27 08:49:09.581719 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0356233b-3320-419f-97b8-f24899175020 admin admin] PATH_INFO: `/v3/projects/72cc073e50e841dbbdd445ba2a4f8256` {{(pid=87172) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 27 08:49:09.592121 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0356233b-3320-419f-97b8-f24899175020 admin admin] RBAC: Authorizing `identity:delete_project(project_id=72cc073e50e841dbbdd445ba2a4f8256)` {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 27 08:49:09.594105 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0356233b-3320-419f-97b8-f24899175020 admin admin] RBAC: Authorization granted {{(pid=87172) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 27 08:49:09.640055 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.notifications [None req-0356233b-3320-419f-97b8-f24899175020 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72cc073e50e841dbbdd445ba2a4f8256', 'request_id': 'req-0356233b-3320-419f-97b8-f24899175020'} {{(pid=87172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 08:49:09.647173 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.notifications [None req-0356233b-3320-419f-97b8-f24899175020 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72cc073e50e841dbbdd445ba2a4f8256', 'request_id': 'req-0356233b-3320-419f-97b8-f24899175020'} {{(pid=87172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 08:49:09.654286 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.notifications [None req-0356233b-3320-419f-97b8-f24899175020 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72cc073e50e841dbbdd445ba2a4f8256', 'request_id': 'req-0356233b-3320-419f-97b8-f24899175020'} {{(pid=87172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 08:49:09.666761 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.notifications [None req-0356233b-3320-419f-97b8-f24899175020 admin admin] The token cache is being invalidate because project 72cc073e50e841dbbdd445ba2a4f8256 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87172) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 27 08:49:09.667052 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.notifications [None req-0356233b-3320-419f-97b8-f24899175020 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 08:49:09.667778 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG keystone.notifications [None req-0356233b-3320-419f-97b8-f24899175020 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87172) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 27 08:49:09.669468 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: [pid: 87172|app: 0|req: 631/1259] 10.222.0.62 () {58 vars in 1232 bytes} [Fri May 27 08:49:09 2022] DELETE /identity/v3/projects/72cc073e50e841dbbdd445ba2a4f8256 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 27 08:49:19.328656 dv-osbrick-762776-7-ceph devstack@keystone.service[87173]: DEBUG dbcounter [-] [87173] Writing DB stats keystone:SELECT=42,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87173) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 08:49:19.663657 dv-osbrick-762776-7-ceph devstack@keystone.service[87172]: DEBUG dbcounter [-] [87172] Writing DB stats keystone:SELECT=47,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}